Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Metric AI service #1322

Open
wants to merge 70 commits into
base: main
Choose a base branch
from
Open

Metric AI service #1322

wants to merge 70 commits into from

Conversation

tybalex
Copy link
Contributor

@tybalex tybalex commented Apr 19, 2023 •
edited
Loading

This is the python service implementation of the Epic attached.
a few concepts in this service:

  • A job: A list of namespaces of a cluster to be watched, selected by user, similar to the watchlist we already have in log anomaly detection
  • A job run: run metric analysis for a job at the requested timestamp.

What's included in this PR:

  1. Http server in main.py: provide a few APIs, the most important one is /run_job/{job_id}/, which is the logic to run a job. The other APIs are used by gateway plugin.
  2. filter_anomaly_metric.py defines the rules to filter out normal metrics.
  3. the model dir, cnn_model.py defines the structure of the CNN model and metric_pattern_classification.py defines the logic to train/eval/predict with the model.
  4. Grafana_dashboard_utils.py defines functions to create/delete dashboardjson.
  5. the tests dir: unit-test

kralicky and others added 29 commits March 2, 2023 13:08
@kralicky
update python code generator
c706cec
@tybalex
init commit for metric analysis service
8186e59
@tybalex
fix indenting
43aa4e0
@tybalex
rename file
3318aae
@tybalex
temp add test script
34b2d67
@tybalex
update functions to pull metrics and queroes
cc5daa9
@tybalex
basic examples of using ks-2samp as anomaly detection and apply on di…
8127c7f 
…fferent metric data
@tybalex
simple APIs + improve MAD with better filter rule
7a96ae8
@tybalex
update apis, improved filter methods for abnormal metrics.
30db856
@tybalex
add init changes to incorpate CNN model. and adapt the APIs
2cc272d
@tybalex
complete API by use nats kv as storage
ad01e6d
@tybalex
add API to delete task
0196cdf
@tybalex
example json file to add dynamic grafana dashboard
6dc90f9
@tybalex
swtich from ks_test to t-test -- this will better filter out normal m…
fdf065f 
…etrics, and it can correctly capture some spikes.
@tybalex
init commit
c9848f1
@tybalex
fix error
fc33da1
@tybalex
Merge branch 'main' into metric-ai-plugin
4053ecc
@tybalex
add more apis that UI needs
0dd3415
@tybalex
fix minor bug, for delete api
9274a79
@tybalex
apis that works for gateway plugin
00631cc
@tybalex
add code for using python http API to create folder/dynamic dashboards.
0979065
@tybalex
updatee an API for delete job runs, update field and add a new fiend …
8f3f4e6 
…for job run status:
@tybalex
minor fix adapt to gateway plugin API changes
851a39a
@tybalex
add precommit configs
7fbe2eb
@tybalex
add example code in the notebook to create dashboard with proper titl…
47b34da 
…e rows
@tybalex
add docstring to proto
fdc3f40
@tybalex
add README, add docstrings, comments, basic Test coverage , reorg str…
e76ee85 
…ucture of folder
@tybalex
precommit fix lintings
498193b
@tybalex
merge from main
a35f144
@tybalex tybalex linked an issue Apr 19, 2023 that may be closed by this pull request
[EPIC] Metric anomaly pattern matching #1136
Open
7 tasks
@tybalex tybalex requested a review from kralicky April 28, 2023 03:13
@tybalex
Copy link
Contributor Author

tybalex commented Apr 28, 2023

Regard to the model file, @AmartC will move it to Opni's internal S3 bucket.

tybalex and others added 11 commits April 27, 2023 20:33
@tybalex
update go.mod to use latest ragu version
525dbdf
@tybalex
Merge branch 'main' into metric-ai-plugin
353625b
@tybalex
update go.mod
968ce5c
@tybalex
Merge branch 'main' into metric-service
edd73a5
@tybalex
Merge remote-tracking branch 'origin/metric-ai-plugin' into metric-se…
e4a094c 
…rvice
@tybalex
Merge branch 'metric-service' of https://github.com/rancher/opni into…
bb05d8a 
… metric-service
@tybalex
Merge branch 'main' into metric-service
482886d
@kralicky
Refactor aiops plugin to use updated plugin structure and driver patt…
f6b23dd 
…ern (#1362)

* Refactor aiops plugin to use updated plugin structure and driver pattern

* Add driver imports to plugins/aiops/main.go

* Move k8s-specific nats utils to a separate package
@kralicky
Implement test env dashboard driver for metric anomaly
2816d03
@kralicky
start testenv agents synchronously
663ecc6
@kralicky
Example code for moving some metric anomaly api methods to aiops plugin
c872e96
@tybalex tybalex mentioned this pull request Apr 29, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@AmartC AmartC Awaiting requested review from AmartC

@kralicky kralicky Awaiting requested review from kralicky

@dbason dbason Awaiting requested review from dbason

@alexandreLamarre alexandreLamarre Awaiting requested review from alexandreLamarre

Requested changes must be addressed to merge this pull request.

Assignees

@tybalex tybalex

Labels
aiops
Projects
None yet
Milestone
No milestone
2 participants
@tybalex @kralicky