[AutoSP] (Sequence Parallelism) support for Multimodal Models (ViT + LLM)#7984

delock merged 35 commits into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

nathon-lee:multimodal-seq-parallelnathon-lee/DeepSpeed_woo:multimodal-seq-parallelCopy head branch name to clipboard