Skip to content

Commit aca95f1

Browse files
committed
updte gke yaml
Signed-off-by: Juncheng Gu <jcgu@google.com>
1 parent df3b091 commit aca95f1

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

examples/gke/benchmarks/deploy-cpu-offload.yaml

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -30,8 +30,10 @@ spec:
3030
key: token
3131
- name: SKIP_JAX_PRECOMPILE
3232
value: "1"
33-
- name: TPU_OFFLOAD_CPU_CACHE_SIZE_GB
34-
value: "1024"
33+
- name: TPU_OFFLOAD_NUM_CPU_CHUNKS
34+
value: "4096"
35+
- name: TPU_OFFLOAD_NUM_STAGING_BLOCKS
36+
value: "256"
3537
ports:
3638
- containerPort: 8000
3739
resources:

0 commit comments

Comments
 (0)