-
Notifications
You must be signed in to change notification settings - Fork 274
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Testing] Enhance sanity testing framework #3530
Comments
[Triage] Hi @DarshitChanpura, thank you for filing this issue. More testing is always helpful and this has clear steps. Marking as triaged. |
Gonna start looking into this |
@DarshitChanpura the existing tests make use of a number mock API Calls. I would like to confirm that for the scope this issue we don't want to use these mocks(For the main calls at least) so we can sanity check both OSS Plugin and OSS Dashboards Plugin. Is that correct? |
@DarshitChanpura Another question, in the text file with the steps. the section "Dashboards Basics", it mentions opening the browser in incognito mode and check if the data is correct. The incognito part made me not sure if that sections another set of tests, or its a manual verifcation that i should do now to check if the tests are working as expected. |
We would like to replicate the steps as test. They are all mostly for front-end (jest_integration). The API calls should be translated to tests on the backend (we can utilize the test framework to do so)
your observation is correct. It's manual verification by logging in as another user to verify that the action was successful. |
@DarshitChanpura Its been a while since there have been updates on this issue, can you check where this is at? |
Here is the PR from @samuelcostae : opensearch-project/opensearch-dashboards-functional-test#958 to add tests from the runbook |
This issue is currently blocked awaiting review from maintainers of the functional tests repo. |
Closed as completed via: opensearch-project/opensearch-dashboards-functional-test#958 |
As part of initial effort, sanity tests were added to verify whether security plugin was installed correctly. With that in place, this issue proposes addition of a series of tests that run with
:integTestRemote
and the intent is to automate tests performed manually after every release.These tests will run in every CI run as well as when distribution builds are being invoked. These tests will also help keep healthy check on whether incoming changes change security plugin behavior.
Here is the runbook for the tests:
sanity-testing-runbook.txt
Exit criteria:
The text was updated successfully, but these errors were encountered: