Skip to content

fix(zero): Ensure full gradient reduction for Muon optimizer with reduce_scatter#7878

Open
nathon-lee wants to merge 6 commits into
deepspeedai:masterfrom
nathon-lee:fix_cp_7807
Open

fix(zero): Ensure full gradient reduction for Muon optimizer with reduce_scatter#7878
nathon-lee wants to merge 6 commits into
deepspeedai:masterfrom
nathon-lee:fix_cp_7807

Merge branch 'deepspeedai:master' into fix_cp_7807

4665aa9
Select commit
Loading
Failed to load commit list.