Skip to content

Commit

Permalink
Fix microservice name error and add platform explict for codegen and …
Browse files Browse the repository at this point in the history
…codetrans (#139)

* fix microservice name error and add platform explict for codegen and codetrans.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

* change README.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

* change the e2e test for gmc on GenAIInfra.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

* change e2e test.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
  • Loading branch information
Steve Zhang authored Jun 28, 2024
1 parent 2d17c90 commit ac6c247
Show file tree
Hide file tree
Showing 5 changed files with 5 additions and 3 deletions.
2 changes: 1 addition & 1 deletion microservices-connector/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,7 @@ export SYSTEM_NAMESPACE=system
kubectl create namespace $SYSTEM_NAMESPACE
```

**NOTE:** The SYSTEM_NAMESPACE should keep the same with the namespace defined in gmc-manager.yaml and gmc-manager-rbac.yaml.
**NOTE:** The `SYSTEM_NAMESPACE` should keep the same with the namespace defined in gmc-manager.yaml and gmc-manager-rbac.yaml.

**Create ConfigMap for GMC to hold GenAI Components and GMC Router manifests**

Expand Down
2 changes: 1 addition & 1 deletion microservices-connector/config/samples/codegen_gaudi.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ spec:
endpoint: /v1/chat/completions
- name: TgiGaudi
internalService:
serviceName: tgi-service
serviceName: tgi-gaudi-svc
config:
LLM_MODEL_ID: ise-uiuc/Magicoder-S-DS-6.7B
endpoint: /generate
Expand Down
1 change: 1 addition & 0 deletions microservices-connector/config/samples/codegen_xeon.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ metadata:
labels:
app.kubernetes.io/name: gmconnector
app.kubernetes.io/managed-by: kustomize
gmc/platform: xeon
name: codegen
namespace: codegen
spec:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ spec:
endpoint: /v1/chat/completions
- name: TgiGaudi
internalService:
serviceName: tgi-service
serviceName: tgi-gaudi-svc
config:
LLM_MODEL_ID: HuggingFaceH4/mistral-7b-grok
endpoint: /generate
Expand Down
1 change: 1 addition & 0 deletions microservices-connector/config/samples/codetrans_xeon.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ metadata:
labels:
app.kubernetes.io/name: gmconnector
app.kubernetes.io/managed-by: kustomize
gmc/platform: xeon
name: codetrans
namespace: codetrans
spec:
Expand Down

0 comments on commit ac6c247

Please sign in to comment.