examples/qwen3: TP all-reduce via mscclpp fused-packet, with equivalence test and microbenchmark#268

Open

chhwang wants to merge 26 commits into

mainfrom

qwen3-q7-allreduce

Commits on Jun 13, 2026

ark-dev: examples/qwen3: TP all-reduce component — mscclpp fused-packet all-reduce at Qwen3 attn-output and MLP-output shapes, equivalence test, microbenchmark
ark-dev
committed

Commits on Jun 14, 2026

ark-dev: examples/qwen3: TP all-reduce component — mscclpp fused-packet all-reduce at Qwen3 attn-output and MLP-output shapes, equivalence test, microbenchmark
ark-dev
committed

Commits on Jun 15, 2026

Commits on Jun 16, 2026

Commits on Jun 17, 2026