Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update tests to use new Caikit + TGIS images #1009

Merged
merged 15 commits into from
Nov 14, 2023
Merged

Update tests to use new Caikit + TGIS images #1009

merged 15 commits into from
Nov 14, 2023

Conversation

bdattoma
Copy link
Contributor

@bdattoma bdattoma commented Nov 7, 2023

Updating the tests to reflect the new architecture of Caikit runtime with TGIS, as implemented in opendatahub-io/caikit-tgis-serving#107: new runtime is composed by 2 separate containers, one for TGIS and one for Caikit, in the same pod.

@bdattoma bdattoma self-assigned this Nov 7, 2023
@bdattoma bdattoma added needs testing Needs to be tested in Jenkins enhancements Bugfixes, enhancements, refactoring, ... in tests or libraries (PR will be listed in release-notes) labels Nov 7, 2023
@bdattoma
Copy link
Contributor Author

bdattoma commented Nov 8, 2023

tested on rhods-ci-pr-test/2111/ . 2 failures not related to this PR: one GPU test which wasn't excluded (no gpu on the cluster) and one failed for timing issue, the pod wasn't ready by the timeout.

@bdattoma bdattoma added verified This PR has been tested with Jenkins and removed needs testing Needs to be tested in Jenkins labels Nov 8, 2023
@bdattoma bdattoma changed the title Update tests to use new Caikit and TGIS images Update tests to use new Caikit + TGIS images Nov 8, 2023
@bdattoma bdattoma marked this pull request as ready for review November 8, 2023 16:35
@bdattoma bdattoma added the do not merge Do not merge this yet please label Nov 9, 2023
@bdattoma
Copy link
Contributor Author

bdattoma commented Nov 9, 2023

do not merge for now, there is a new change coming into the product image and the test files need to be accordingly changed

github-advanced-security[bot]
github-advanced-security bot found potential problems Nov 13, 2023
View reviewed changes
Copy link

@github-advanced-security github-advanced-security bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Robocop found more than 10 potential problems in the proposed changes. Check the Files changed tab for more details.

@bdattoma
update runtime and model path
05e6267 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
enable script-based install as default
85b5e8f 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
use new runtime without configs
6ade69d 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
restore grpc port
057d1f5 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
restore grpc port
65a500d 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
add test for http protocol
71f5c1d 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
change tag for runtime upgrade test
261b953 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
delete unused file
621274a 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
fix all tokens http response validation
7039a7f 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
add missing test teardown
7c6fd48 
Signed-off-by: bdattoma <bdattoma@redhat.com>
github-advanced-security[bot]
github-advanced-security bot found potential problems Nov 13, 2023
View reviewed changes
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Dismissed Show dismissed Hide dismissed
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Dismissed Show dismissed Hide dismissed
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Outdated
# temporarily disabling these lines - will be finalized in later stage due to a different format
# of streamed reponse when using http protocol instead of grpc
# ${cleaned_response_text}= Replace String Using Regexp ${model_response} data:(\\s+)?" "
# ${cleaned_response_text}= Replace String Using Regexp ${cleaned_response_text} data:(\\s+)?{ {

Check warning

Code scanning / Robocop

Trailing whitespace at the end of line Warning test

Trailing whitespace at the end of line
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Dismissed Show dismissed Hide dismissed
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Dismissed Show dismissed Hide dismissed
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Dismissed Show dismissed Hide dismissed
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Dismissed Show dismissed Hide dismissed
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Fixed Show fixed Hide fixed
ods_ci/tests/Resources/Page/ODH/ODHDashboard/ODHDashboardAPI.resource Dismissed Show dismissed Hide dismissed
ods_ci/tests/Tests/400__ods_dashboard/420__model_serving/422__model_serving_llm.robot Fixed Show fixed Hide fixed
@bdattoma
fix post deployment test
0f8d143 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
fix autoscale test + restore suite setup/teardown
8994b1c 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
Copy link
Contributor Author

bdattoma commented Nov 13, 2023 •
edited
Loading

PR validation:

  1. Entire WatsonX/Kserve suiterhods-smoke/3880 . 3 failures related to the PR changes.
  2. Re-run base deployment test + failed test cases after fixes. rhods-smoke/3881 1 failure.
  3. FINAL: re-run entire suite after fixes: rhods-smoke/3885/ 100% PASS

bdattoma and others added 3 commits November 13, 2023 16:34
@bdattoma
fix robocop alerts
575fe7d 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
fix post install test - change label
285b6b5 
Signed-off-by: bdattoma <bdattoma@redhat.com>
@bdattoma
Merge branch 'master' into f/caikit_tgis
8aa9978
@sonarcloud SonarCloud
Copy link

sonarcloud bot commented Nov 13, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@bdattoma bdattoma removed the do not merge Do not merge this yet please label Nov 14, 2023
@bdattoma bdattoma merged commit 5b47b89 into red-hat-data-services:master Nov 14, 2023
9 of 10 checks passed
ChughShilpa pushed a commit to ChughShilpa/ods-ci that referenced this pull request Nov 28, 2023
@bdattoma
Update tests to use new Caikit + TGIS images (red-hat-data-services#1009
b689337 
)

* update runtime and model path

Signed-off-by: bdattoma <bdattoma@redhat.com>

* enable script-based install as default

Signed-off-by: bdattoma <bdattoma@redhat.com>

* use new runtime without configs

Signed-off-by: bdattoma <bdattoma@redhat.com>

* restore grpc port

Signed-off-by: bdattoma <bdattoma@redhat.com>

* restore grpc port

Signed-off-by: bdattoma <bdattoma@redhat.com>

* add test for http protocol

Signed-off-by: bdattoma <bdattoma@redhat.com>

* change tag for runtime upgrade test

Signed-off-by: bdattoma <bdattoma@redhat.com>

* delete unused file

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix all tokens http response validation

Signed-off-by: bdattoma <bdattoma@redhat.com>

* add missing test teardown

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix post deployment test

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix autoscale test + restore suite setup/teardown

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix robocop alerts

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix post install test - change label

Signed-off-by: bdattoma <bdattoma@redhat.com>

---------

Signed-off-by: bdattoma <bdattoma@redhat.com>
ChughShilpa pushed a commit to ChughShilpa/ods-ci that referenced this pull request Jan 2, 2024
@bdattoma
Update tests to use new Caikit + TGIS images (red-hat-data-services#1009
d2eba5e 
)

* update runtime and model path

Signed-off-by: bdattoma <bdattoma@redhat.com>

* enable script-based install as default

Signed-off-by: bdattoma <bdattoma@redhat.com>

* use new runtime without configs

Signed-off-by: bdattoma <bdattoma@redhat.com>

* restore grpc port

Signed-off-by: bdattoma <bdattoma@redhat.com>

* restore grpc port

Signed-off-by: bdattoma <bdattoma@redhat.com>

* add test for http protocol

Signed-off-by: bdattoma <bdattoma@redhat.com>

* change tag for runtime upgrade test

Signed-off-by: bdattoma <bdattoma@redhat.com>

* delete unused file

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix all tokens http response validation

Signed-off-by: bdattoma <bdattoma@redhat.com>

* add missing test teardown

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix post deployment test

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix autoscale test + restore suite setup/teardown

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix robocop alerts

Signed-off-by: bdattoma <bdattoma@redhat.com>

* fix post install test - change label

Signed-off-by: bdattoma <bdattoma@redhat.com>

---------

Signed-off-by: bdattoma <bdattoma@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jstourac jstourac jstourac approved these changes

@lugi0 lugi0 lugi0 approved these changes

@jgarciao jgarciao Awaiting requested review from jgarciao

@FedeAlonso FedeAlonso Awaiting requested review from FedeAlonso

@tarukumar tarukumar Awaiting requested review from tarukumar

Assignees

@bdattoma bdattoma

Labels
enhancements Bugfixes, enhancements, refactoring, ... in tests or libraries (PR will be listed in release-notes) verified This PR has been tested with Jenkins
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@bdattoma @jstourac @lugi0