forked from red-hat-data-services/ods-ci
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Update tests to use new Caikit + TGIS images (red-hat-data-services#1009
) * update runtime and model path Signed-off-by: bdattoma <bdattoma@redhat.com> * enable script-based install as default Signed-off-by: bdattoma <bdattoma@redhat.com> * use new runtime without configs Signed-off-by: bdattoma <bdattoma@redhat.com> * restore grpc port Signed-off-by: bdattoma <bdattoma@redhat.com> * restore grpc port Signed-off-by: bdattoma <bdattoma@redhat.com> * add test for http protocol Signed-off-by: bdattoma <bdattoma@redhat.com> * change tag for runtime upgrade test Signed-off-by: bdattoma <bdattoma@redhat.com> * delete unused file Signed-off-by: bdattoma <bdattoma@redhat.com> * fix all tokens http response validation Signed-off-by: bdattoma <bdattoma@redhat.com> * add missing test teardown Signed-off-by: bdattoma <bdattoma@redhat.com> * fix post deployment test Signed-off-by: bdattoma <bdattoma@redhat.com> * fix autoscale test + restore suite setup/teardown Signed-off-by: bdattoma <bdattoma@redhat.com> * fix robocop alerts Signed-off-by: bdattoma <bdattoma@redhat.com> * fix post install test - change label Signed-off-by: bdattoma <bdattoma@redhat.com> --------- Signed-off-by: bdattoma <bdattoma@redhat.com>
- Loading branch information
Showing
7 changed files
with
143 additions
and
59 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
30 changes: 0 additions & 30 deletions
30
ods_ci/tests/Resources/Files/llm/caikit_servingruntime.yaml
This file was deleted.
Oops, something went wrong.
27 changes: 27 additions & 0 deletions
27
ods_ci/tests/Resources/Files/llm/caikit_servingruntime_grpc.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
apiVersion: serving.kserve.io/v1alpha1 | ||
kind: ServingRuntime | ||
metadata: | ||
name: caikit-tgis-runtime | ||
spec: | ||
multiModel: false | ||
supportedModelFormats: | ||
# Note: this currently *only* supports caikit format models | ||
- autoSelect: true | ||
name: caikit | ||
containers: | ||
- name: kserve-container | ||
image: quay.io/opendatahub/text-generation-inference:stable | ||
command: ["text-generation-launcher"] | ||
args: ["--model-name=/mnt/models/artifacts/"] | ||
env: | ||
- name: TRANSFORMERS_CACHE | ||
value: /tmp/transformers_cache | ||
- name: transformer-container | ||
image: quay.io/opendatahub/caikit-tgis-serving:fast | ||
env: | ||
- name: RUNTIME_LOCAL_MODELS_DIR | ||
value: /mnt/models | ||
ports: | ||
- containerPort: 8085 | ||
name: h2c | ||
protocol: TCP |
26 changes: 26 additions & 0 deletions
26
ods_ci/tests/Resources/Files/llm/caikit_servingruntime_http.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,26 @@ | ||
apiVersion: serving.kserve.io/v1alpha1 | ||
kind: ServingRuntime | ||
metadata: | ||
name: caikit-tgis-runtime | ||
spec: | ||
multiModel: false | ||
supportedModelFormats: | ||
# Note: this currently *only* supports caikit format models | ||
- autoSelect: true | ||
name: caikit | ||
containers: | ||
- name: kserve-container | ||
image: quay.io/opendatahub/text-generation-inference:stable | ||
command: ["text-generation-launcher"] | ||
args: ["--model-name=/mnt/models/artifacts/"] | ||
env: | ||
- name: TRANSFORMERS_CACHE | ||
value: /tmp/transformers_cache | ||
- name: transformer-container | ||
image: quay.io/opendatahub/caikit-tgis-serving:fast | ||
env: | ||
- name: RUNTIME_LOCAL_MODELS_DIR | ||
value: /mnt/models | ||
ports: | ||
- containerPort: 8080 | ||
protocol: TCP |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters