opensearch-project

~medib/opensearch-project-components/+git/opensearch-performance-analyzer-rca:main

Last commit made on 2023-08-14

Get this branch:: git clone -b main https://git.launchpad.net/~medib/opensearch-project-components/+git/opensearch-performance-analyzer-rca

Only Mehdi B. can upload to this branch. If you are Mehdi B. please log in for upload directions.

Branch merges

Branch information

Name:: main

Repository:: lp:~medib/opensearch-project-components/+git/opensearch-performance-analyzer-rca

Recent commits

acdaa85... by Mehdi B. on 2023-08-14

changed gradle distro url

deb42f3... by Mehdi B. on 2023-08-08

changed gradle distro url

e33436a... by Chenyang Ji <email address hidden> on 2023-08-03

Update docker-compose.yml (#465)

Updating to use "cluster_manager"

Signed-off-by: Chenyang Ji <email address hidden>

749da27... by Jeffrey Liu <email address hidden> on 2023-08-03

SearchBackPressure Policy/Decider Generic Framework Added (#461)

* Remove log files and add DCO (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove extra files (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove styling difference (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove unnecessary file changes (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add RCA_Decider (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Extract Heap Usage from SQlitedb (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Extract required searchbp metrics for deciders (signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add SearchBackPressureRCA Metric (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Use SearchBackPressureRCAMetrics to aggregate metrics (signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add the conf file extracted part for SearchBackPressureRcaConfig.java (signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add MinMaxSlidingWindow in OldGenRca (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Rename SearchBackPressureClusterRCA and add it to AnalysisGraph (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add basic UTs for SearchBackPressureRCA cluster/node level (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add unhealthy/healthy stats UTs for SearchBackPressureRCA cluster/node level (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add healthy resource unit UT (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add UT s both shard/task level (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add a new SearchBp Resource Unit (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add UTs to test shard/task level resource include-ness (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove styling changes for Version.java (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add metadata to resourceSummary (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Update to more general framework (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor the MinMaxSlidingWindow and bug fix (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor Heap Stats Metrics Getter(Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor HeapUsed and HeapMax Getters (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor operate() (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor operate() and remove dead comments (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add new ActionPojo for Searchbp (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add new ActionPojo for Searchbp#2 (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Update SearchBackPressureAction (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add Searchbp Decider (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add Searchbp Policy and Config (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add dummy Searchbp Policy and Config in OpenSearchAnalysis Graph (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Update SearchBackpressure Policy (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Update SearchBackpressure Policy (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Merged Main (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add new AlarmMonitor (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Workable decider (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Workable decider (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Workable pipeline (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Workable pipeline (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Update ActionPojo (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Framework can read from config (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add Policy Increase/Decrease Alarm (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Generic Framework can generate shard/task and increase/decrease actions (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Generic Framework can generate specific actions and read from config (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* removed dead comment for SearchBpActionConfig.java (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* removed dead comment for action/polict (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* removed dead comment for action/policy (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add increase/decrease direction for ActionPojo (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* remove trailing (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Restore to workable solution

Signed-off-by: CoderJeffrey <email address hidden>

* Restore to workable solution (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* remove hourly window size and bucket size (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add hourMonitorConfig to set up alarm monitor (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove unused counter (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* change field description (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* refactor (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* enum added for direction and shard/task dimension (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Use enum for Dimension/Direction for Searchbp Action (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add lambda function for next() in OldGenRCA (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Merged main with build.gradle (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* resolve nit#1 (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* resolve nit#2 (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* refactor OpenSearchAnalysisGraph (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* stream() refactor (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* null check refactor (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Change LOG to debug level for unnecessary info (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* refactor shar/task issue (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* nit fix (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Added JavaDoc for Searchbp Action (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* SearchBackPressureIssue Interface created for refactor (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove dead comment (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

---------

Signed-off-by: CoderJeffrey <email address hidden>

2b970e3... by Jeffrey Liu <email address hidden> on 2023-07-20

SearchBackPressure Service Node/Cluster RCA (#437)

* Remove log files and add DCO (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove extra files (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove styling difference (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove unnecessary file changes (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add RCA_Decider (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Extract Heap Usage from SQlitedb (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Extract required searchbp metrics for deciders (signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add SearchBackPressureRCA Metric (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Use SearchBackPressureRCAMetrics to aggregate metrics (signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add the conf file extracted part for SearchBackPressureRcaConfig.java (signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add MinMaxSlidingWindow in OldGenRca (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Rename SearchBackPressureClusterRCA and add it to AnalysisGraph (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add basic UTs for SearchBackPressureRCA cluster/node level (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add unhealthy/healthy stats UTs for SearchBackPressureRCA cluster/node level (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add healthy resource unit UT (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add UT s both shard/task level (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add a new SearchBp Resource Unit (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add UTs to test shard/task level resource include-ness (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove styling changes for Version.java (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Add metadata to resourceSummary (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Update to more general framework (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor the MinMaxSlidingWindow and bug fix (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor Heap Stats Metrics Getter(Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor HeapUsed and HeapMax Getters (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor operate() (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Refactor operate() and remove dead comments (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Merged Main (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Merged Main (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* remove trailing space in build.gradle (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* nit javadoc update (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* nit javadoc updates (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* nit javadoc updates (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Remove dead comments (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* update javadoc (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* LOG Level Change (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

* Change from static class to enum (Signed-off-by: Jeffrey Liu <email address hidden>)

Signed-off-by: CoderJeffrey <email address hidden>

---------

Signed-off-by: CoderJeffrey <email address hidden>

6f780f1... by =?utf-8?q?Filip_Drobnjakovi=C4=87?= <email address hidden> on 2023-07-11

REST layer UT's for QueryRcaRequestHandler (#436)

* Initial tests set up.

Signed-off-by: Filip Drobnjakovic <email address hidden>

* Muted RCA test.

Signed-off-by: Filip Drobnjakovic <email address hidden>

* Expand muted nodes update with config file.

Signed-off-by: Filip Drobnjakovic <email address hidden>

---------

Signed-off-by: Filip Drobnjakovic <email address hidden>

cc70891... by Chenyang Ji <email address hidden> on 2023-07-11

[CVE-2023-33201] Upgrade bcpkix to bcpkix-jdk15to18 (#446)

Signed-off-by: Chenyang Ji <email address hidden>

bb56be4... by Chenyang Ji <email address hidden> on 2023-07-10

fixing Mockito initialization issue (#443)

Signed-off-by: Chenyang Ji <email address hidden>
Co-authored-by: Chenyang Ji <email address hidden>

3a70620... by Chenyang Ji <email address hidden> on 2023-07-10

use mavenLocal as the first entry in repositories section (#438)

Signed-off-by: Chenyang Ji <email address hidden>
Co-authored-by: Chenyang Ji <email address hidden>

3d9af2c... by Chenyang Ji <email address hidden> on 2023-07-10

[CVE-2023-33201] Upgrade bcprov to bcprov-jdk15to18 (#439)

Signed-off-by: Chenyang Ji <email address hidden>
Co-authored-by: Chenyang Ji <email address hidden>

»