Add torch_xla TPU support for ZeRO-1/2#7917

PKUWZP wants to merge 9 commits into

masterdeepspeedai/DeepSpeed:masterfrom

codex/tpu-xla-zero12deepspeedai/DeepSpeed:codex/tpu-xla-zero12Copy head branch name to clipboard