Installation guide for OpenShift #5436
-
|
Hi, can i ask if there's an installation guide or helm chart for installation of Triton with HPA on Openshift? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
There seems to be an NVIDIA lab on deploying an AI model that uses OpenShift with Triton that can be publicly viewed. You may be able to sign up for it for free as well to access the files, but it should be a great resource either way: https://docs.nvidia.com/launchpad/ai/classification-openshift/latest/index.html This has some information about horizontal pod autoscaling, but in the context of Kubernetes: https://developer.nvidia.com/blog/deploying-nvidia-triton-at-scale-with-mig-and-kubernetes/ CC: @tanayvarshney |
Beta Was this translation helpful? Give feedback.
There seems to be an NVIDIA lab on deploying an AI model that uses OpenShift with Triton that can be publicly viewed. You may be able to sign up for it for free as well to access the files, but it should be a great resource either way: https://docs.nvidia.com/launchpad/ai/classification-openshift/latest/index.html
This has some information about horizontal pod autoscaling, but in the context of Kubernetes: https://developer.nvidia.com/blog/deploying-nvidia-triton-at-scale-with-mig-and-kubernetes/
CC: @tanayvarshney