File tree Expand file tree Collapse file tree 2 files changed +5
-5
lines changed
Expand file tree Collapse file tree 2 files changed +5
-5
lines changed Original file line number Diff line number Diff line change @@ -18,13 +18,13 @@ export MAX_TOTAL_TOKENS=2048
1818Run tgi on xeon.
1919
2020``` bash
21- cd deplopyment /docker_compose
21+ cd deployment /docker_compose
2222docker compose -f compose.yaml up -d tgi-server
2323```
2424
2525Run tgi on gaudi.
2626
2727``` bash
28- cd deplopyment /docker_compose
28+ cd deployment /docker_compose
2929docker compose -f compose.yaml up -d tgi-gaudi-server
3030```
Original file line number Diff line number Diff line change @@ -43,7 +43,7 @@ bash ./launch_vllm_service.sh ${port_number} ${model_name}
4343#### Launch vLLM service with docker compose
4444
4545``` bash
46- cd deplopyment /docker_compose
46+ cd deployment /docker_compose
4747docker compose -f compose.yaml up vllm-server -d
4848```
4949
@@ -64,8 +64,8 @@ Set `hw_mode` to `hpu`.
64641 . Option 1: Use docker compose for quick deploy
6565
6666``` bash
67- cd deplopyment /docker_compose
68- docker compose -f compose.yaml vllm-gaudi-server up -d
67+ cd deployment /docker_compose
68+ docker compose -f compose.yaml up vllm-gaudi-server -d
6969```
7070
71712 . Option 2: Use scripts to set parameters.
You can’t perform that action at this time.
0 commit comments