Skip to content

Commit

Permalink
Merge pull request opendatahub-io#63 from heyselbi/iss-58-quickstart
Browse files Browse the repository at this point in the history
addressing comments from PR 61
  • Loading branch information
openshift-merge-robot authored Aug 25, 2023
2 parents c22506e + 0cdce4e commit ec434e5
Show file tree
Hide file tree
Showing 5 changed files with 10 additions and 12 deletions.
4 changes: 2 additions & 2 deletions demo/kserve/custom-manifests/minio/minio-secret.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,5 +8,5 @@ metadata:
serving.kserve.io/s3-useanoncredential: "false" # omitting this is the same as false, if true will ignore provided credential and use anonymous credentials
name: storage-config
stringData:
"AWS_ACCESS_KEY_ID": "<accesskey>"
"AWS_SECRET_ACCESS_KEY": "<secretkey>"
"AWS_ACCESS_KEY_ID": "admin"
"AWS_SECRET_ACCESS_KEY": "password"
4 changes: 2 additions & 2 deletions demo/kserve/custom-manifests/minio/minio.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -24,9 +24,9 @@ spec:
- /data1
env:
- name: MINIO_ACCESS_KEY
value: <accesskey>
value: admin
- name: MINIO_SECRET_KEY
value: <secretkey>
value: password
image: quay.io/opendatahub/modelmesh-minio-examples:caikit-flan-t5
imagePullPolicy: Always
name: minio
9 changes: 4 additions & 5 deletions demo/kserve/deploy-remove.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,14 +10,13 @@ Before proceeding, please make sure you are in the `/caikit-tgis-serving/demo/ks
If you have your model in another S3-like object storage (e.g., AWS S3), you can skip this step.
We will create a new project/namespace for minio and deploy it together with service account and data connection (secret with generated access key ID and secret access key).
~~~
ACCESS_KEY_ID=THEACCESSKEY
SECRET_ACCESS_KEY=$(openssl rand -hex 32)
ACCESS_KEY_ID=admin
SECRET_ACCESS_KEY=password
MINIO_NS=minio
oc new-project ${MINIO_NS}
sed "s/<accesskey>/$ACCESS_KEY_ID/g" ./custom-manifests/minio/minio.yaml | sed "s+<secretkey>+$SECRET_ACCESS_KEY+g" | tee ./minio-current.yaml | oc -n ${MINIO_NS} apply -f -
sed "s/<accesskey>/$ACCESS_KEY_ID/g" ./custom-manifests/minio/minio-secret.yaml | sed "s+<secretkey>+$SECRET_ACCESS_KEY+g" |sed "s/<minio_ns>/$MINIO_NS/g" | tee ./minio-secret-current.yaml | oc -n ${MINIO_NS} apply -f -
oc apply -f minio/minio.yaml -n ${MINIO_NS}
sed s/<minio_ns>/$MINIO_NS/g" ./custom-manifests/minio/minio-secret.yaml | tee ./minio-secret-current.yaml | oc -n ${MINIO_NS} apply -f -
sed "s/<minio_ns>/$MINIO_NS/g" ./custom-manifests/minio/serviceaccount-minio.yaml | tee ./serviceaccount-minio-current.yaml | oc -n ${MINIO_NS} apply -f -
~~~
Instructions above deploy an already containerized LLM model. To containerize your own LLM model into a minio bucket for testing, follow instructions [here](/demo/kserve/create-minio.md).
Expand Down
3 changes: 1 addition & 2 deletions demo/kserve/install-manual.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,8 +44,7 @@ oc -n istio-system apply -f custom-manifests/service-mesh/smmr-${TARGET_OPERATOR
oc apply -f custom-manifests/service-mesh/peer-authentication.yaml
oc apply -f custom-manifests/service-mesh/peer-authentication-${TARGET_OPERATOR_TYPE}.yaml
~~~
This is needed because of [this](https://access.redhat.com/documentation/en-us/openshift_container_platform/4.12/html/serverless/serving#serverless-domain-mapping-custom-tls-cert_domain-mapping-custom-tls-cert).

We use PeerAuthentications to enable mTLS according to [Openshift Serverless Documentation](https://access.redhat.com/documentation/en-us/red_hat_openshift_serverless/1.28/html/serving/configuring-custom-domains-for-knative-services#serverless-domain-mapping-custom-tls-cert_domain-mapping-custom-tls-cert)
~~~
oc apply -f custom-manifests/serverless/operators.yaml
sleep 30
Expand Down
2 changes: 1 addition & 1 deletion docs/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ There are three ways to install the KServe/Caikit/TGIS stack (includes the insta
2. [Manual installation](/demo/kserve/install-manual.md)

## Demos with LLM model
- [Deploy a model and remove/undeploy a model](/docs/deploy-remove.md)
- [Deploy a model and remove/undeploy a model](/demo/kserve/deploy-remove.md)
- [Split traffic](/demo/kserve/traffic-splitting.md)
- [Upgrade runtime](/demo/kserve/upgrade-runtime.md)
- [Access metrics](/demo/kserve/metrics.md)
Expand Down

0 comments on commit ec434e5

Please sign in to comment.