Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update compose.yaml with missing runc runtime #922

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Update compose.yaml with missing runc runtime #922

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 10 additions & 3 deletions AudioQnA/docker_compose/intel/hpu/gaudi/compose.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,8 @@ services:
no_proxy: ${no_proxy}
http_proxy: ${http_proxy}
https_proxy: ${https_proxy}
HABANA_VISIBLE_DEVICES: all

HABANA_VISIBLE_DEVICES: 0
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why use a fixed card number? Setting to 'all' allows the system to automatically allocate a card, so I don't think your code change is appropriate.

OMPI_MCA_btl_vader_single_copy_mechanism: none
runtime: habana
cap_add:
Expand All @@ -24,6 +25,7 @@ services:
ports:
- "3001:9099"
ipc: host
runtime: runc
environment:
ASR_ENDPOINT: ${ASR_ENDPOINT}
speecht5-service:
Expand All @@ -36,7 +38,8 @@ services:
no_proxy: ${no_proxy}
http_proxy: ${http_proxy}
https_proxy: ${https_proxy}
HABANA_VISIBLE_DEVICES: all

HABANA_VISIBLE_DEVICES: 1
OMPI_MCA_btl_vader_single_copy_mechanism: none
runtime: habana
cap_add:
Expand All @@ -47,6 +50,7 @@ services:
container_name: tts-service
ports:
- "3002:9088"
runtime: runc
ipc: host
environment:
TTS_ENDPOINT: ${TTS_ENDPOINT}
Expand All @@ -64,7 +68,8 @@ services:
HUGGING_FACE_HUB_TOKEN: ${HUGGINGFACEHUB_API_TOKEN}
HF_HUB_DISABLE_PROGRESS_BARS: 1
HF_HUB_ENABLE_HF_TRANSFER: 0
HABANA_VISIBLE_DEVICES: all

HABANA_VISIBLE_DEVICES: 2
OMPI_MCA_btl_vader_single_copy_mechanism: none
ENABLE_HPU_GRAPH: true
LIMIT_HPU_GRAPH: true
Expand All @@ -78,6 +83,7 @@ services:
llm:
image: ${REGISTRY:-opea}/llm-tgi:${TAG:-latest}
container_name: llm-tgi-gaudi-server
runtime: runc
depends_on:
- tgi-service
ports:
Expand Down Expand Up @@ -111,6 +117,7 @@ services:
- TTS_SERVICE_HOST_IP=${TTS_SERVICE_HOST_IP}
- TTS_SERVICE_PORT=${TTS_SERVICE_PORT}
ipc: host
runtime: runc
restart: always

networks:
Expand Down