Reduce image size and enhance caching#1245

CienetStingLin merged 1 commit intovllm-project:mainvllm-project/tpu-inference:mainfrom

wdhongtw:build-cachewdhongtw/tpu-inference:build-cacheCopy head branch name to clipboard