Integrate Sonic-Moe in FSDP#1176

Draft

ChangyiYang wants to merge 10 commits intoTHUDM:mainfrom

ChangyiYang:sonic-moe

Commits on Dec 28, 2025

only forward, init try

slime-local
authored and
Hecate0821
committed
Arg fix
Hecate0821
committed
Clean, and remove redundant permutation
Hecate0821
committed
move arguement

ChangyiYang
authored and
Hecate0821
committed
correctly passing args

ChangyiYang
authored and
Hecate0821
committed
remove import

ChangyiYang
authored and
Hecate0821
committed
right layout

ChangyiYang
authored and
Hecate0821
committed
clean import

ChangyiYang
authored and
Hecate0821
committed
fix weight interleave

ChangyiYang
authored and
Hecate0821
committed

Commits on Jan 1, 2026

log, revert later
Hecate0821
committed