Skip to content

Commit

Permalink
Update model-management.md
Browse files Browse the repository at this point in the history
  • Loading branch information
nstogner authored Aug 30, 2024
1 parent 337c43e commit b45cc19
Showing 1 changed file with 20 additions and 2 deletions.
22 changes: 20 additions & 2 deletions docs/model-management.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,25 @@ models:
MY_CUSTOM_ENV_VAR: "some-value"
```

### Adding Custom Models
### Adding Custom Models with Helm

If you prefer to add a custom model via the same Helm chart you use for installed KubeAI, you can add your custom model entry into the `.models.catalog` array of your existing Helm values file:

```yaml
# ...
models:
catalog:
my-custom-model-name:
enabled: true
features: ["TextEmbedding"]
owner: me
url: "hf://me/my-custom-model"
resourceProfile: CPU:1
```

They you can re-run `helm upgrade` with the same flags you used to install KubeAI.

### Adding Custom Models Directly

You can add your own model by defining a Model yaml file and applying it using `kubectl apply -f model.yaml`.

Expand All @@ -69,4 +87,4 @@ kubectl explain models.spec.engine

### Model Management UI

We are considering adding a UI for managing models in a running KubeAI instance. Give the [GitHub Issue](https://github.com/substratusai/kubeai/issues/148) a thumbs up if you would be interested in this feature.
We are considering adding a UI for managing models in a running KubeAI instance. Give the [GitHub Issue](https://github.com/substratusai/kubeai/issues/148) a thumbs up if you would be interested in this feature.

0 comments on commit b45cc19

Please sign in to comment.