Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix a flaky test that relies on terminate_after for an exact count match #10836

Closed
wants to merge 32 commits into from

Conversation

austintlee
Copy link
Contributor

@austintlee austintlee commented Oct 23, 2023

Description

[Describe what this change achieves]

Related Issues

Resolves #10435

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
  • [ x] Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

github-actions bot commented Oct 23, 2023

Compatibility status:

Checks if related components are compatible with change 5c190c2

Incompatible components

Incompatible components: [https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/alerting.git]

dzane17 and others added 14 commits January 19, 2024 09:59
…ect#10503)

* revive remote cluster state auto restore integ tests

Signed-off-by: bansvaru <bansvaru@amazon.com>
… loss recovery (opensearch-project#10447)

* Remote Restore Cluster Metadata if local disk state lost after quorum loss

Signed-off-by: bansvaru <bansvaru@amazon.com>
…tch. (Issue # 10435)

Signed-off-by: Austin Lee <austin@aryn.ai>
Signed-off-by: Austin Lee <austin@aryn.ai>
Signed-off-by: Austin Lee <austin@aryn.ai>
…ect#10503)

* revive remote cluster state auto restore integ tests

Signed-off-by: bansvaru <bansvaru@amazon.com>
… loss recovery (opensearch-project#10447)

* Remote Restore Cluster Metadata if local disk state lost after quorum loss

Signed-off-by: bansvaru <bansvaru@amazon.com>
…ect#10503)

* revive remote cluster state auto restore integ tests

Signed-off-by: bansvaru <bansvaru@amazon.com>
… loss recovery (opensearch-project#10447)

* Remote Restore Cluster Metadata if local disk state lost after quorum loss

Signed-off-by: bansvaru <bansvaru@amazon.com>
…ect#10503)

* revive remote cluster state auto restore integ tests

Signed-off-by: bansvaru <bansvaru@amazon.com>
… loss recovery (opensearch-project#10447)

* Remote Restore Cluster Metadata if local disk state lost after quorum loss

Signed-off-by: bansvaru <bansvaru@amazon.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Austin Lee <austin@aryn.ai>
Signed-off-by: Austin Lee <austin@aryn.ai>
Copy link
Contributor

❌ Gradle check result for 5c190c2: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

❌ Gradle check result for 1fd4fdf: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

❌ Gradle check result for 2c2d4bd: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@austintlee
Copy link
Contributor Author

@reta Can you take another look? I am not sure why I have DCO failing.

@reta
Copy link
Collaborator

reta commented Feb 4, 2024

@reta Can you take another look? I am not sure why I have DCO failing.

@austintlee sure, could you please rebase and squash your changes into single commit? I should resolve the DCO check

@austintlee
Copy link
Contributor Author

@reta One of the tests is now failing locally with and without concurrent search enabled. I need to look into that. (oh boy)

@reta
Copy link
Collaborator

reta commented Feb 5, 2024

@reta One of the tests is now failing locally with and without concurrent search enabled. I need to look into that. (oh boy)

Oh man, @austintlee is it related to your change? If not, could you share what test you struggle with? Thank you.

@austintlee
Copy link
Contributor Author

testSimpleTerminateAfterTrackTotalHitsUpToSize

@reta
Copy link
Collaborator

reta commented Feb 5, 2024

testSimpleTerminateAfterTrackTotalHitsUpToSize

It supposed to be fixed, right? Or it looks like we need to re-evaluate the cause?

@austintlee
Copy link
Contributor Author

@reta strangely, I had a change that was not related to the size=0 case. I reverted it.

Now, my local repo was completely out of sync with upstream so I had to do some git reset and rebase to get my diff to show up correctly and prepared a new PR - #12179. Do you think this can still make the 2.12 train?

@andrross
Copy link
Member

I believe this is superseded by #12179 so I'm closing it. Please correct me if I'm wrong @austintlee

@andrross andrross closed this Feb 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Search Search query, autocomplete ...etc skip-changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Search requests with size=0 & terminate_after sometimes return incorrectly hit count