Skip to content

Pull requests: deepspeedai/DeepSpeed

New pull request New
131 Open 3,681 Closed
131 Open 3,681 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Reduce blockDim in fake_quantize_kernel for improved SM occupancy
#8115 opened Jul 2, 2026 by flutist Contributor Loading…
1
Add Ulysses SP support for FLA gated-delta context parallelism
#8114 opened Jul 2, 2026 by xylian86 Collaborator Loading…
3
Fix ZeRO-3 autocast gather with mixed parameter dtypes
#8113 opened Jul 2, 2026 by tohtana Collaborator Loading…
Fix formatting CI failures in benchmarks/opsd benchmark scripts
#8111 opened Jul 1, 2026 by Copilot AI • Draft
@PKUWZP
1
Make DCO workflow Probot compatible
#8110 opened Jul 1, 2026 by tohtana Collaborator Loading…
ZeRO-3: stream partitioning of oversized parameters in zero.Init
#8103 opened Jun 30, 2026 by Achyuthan-S Contributor Loading…
1
5
Warn when zero.Init silently falls back to a single rank (#8084)
#8089 opened Jun 24, 2026 by akshansh47 Loading…
1
2
fix: use local ev_values and wrap dict.values() in list()
#8087 opened Jun 23, 2026 by hashwnath Loading…
3 tasks done
1
1
ZeRO 1/2: wait on all IPG-bucket producer streams in average_tensor (#8061)
#8080 opened Jun 19, 2026 by arunshar Contributor Loading…
1
10
feat: add Trackio as a new experiment monitoring backend
#8065 opened Jun 15, 2026 by chanduripranav Loading…
1
4
Add AutoEP + AutoTP parallel folding
#8064 opened Jun 13, 2026 by tohtana Collaborator Loading…
11
feat(zenflow): run the overlapped CPU optimizer in a native process
#8058 opened Jun 10, 2026 by Antlera Collaborator Loading…
10
zero3: defer param release during retain_graph backward #7352
#8045 opened Jun 3, 2026 by nathon-lee Contributor • Draft
7
Add On-Policy Distillation (OPSD) Trainer backend in DeepSpeed
#8027 opened May 26, 2026 by PKUWZP Collaborator Loading…
4 of 5 tasks
8
Add Qwen 3.5 preset to AutoTP
#7978 opened Apr 16, 2026 by tohtana Collaborator • Draft
1
1
Refactor/torch autocast encapsulate global state
#7946 opened Apr 2, 2026 by nathon-lee Contributor Loading…
2
Fix ZeRO-3 optimizer initialization validation (#7844)
#7929 opened Mar 28, 2026 by amadhan882 Loading…
1
9
Add torch_xla TPU support for ZeRO-1/2
#7917 opened Mar 21, 2026 by PKUWZP Collaborator Loading…
18
doc: Remove suggestion to build extensions in parallel
#7899 opened Mar 12, 2026 by Flamefire Contributor Loading…
1
5
Fix Stage 0 + Ulysses crash: make bwc_tensor_model_parallel_rank() resilient to MP API absence
#7888 opened Mar 6, 2026 by nathon-lee Contributor Loading…
3
fix(zero): Ensure full gradient reduction for Muon optimizer with reduce_scatter
#7878 opened Feb 27, 2026 by nathon-lee Contributor Loading…
1
2
fix: correct DistributedAttention output shape and pad uneven sequence lengths (#7842)
#7868 opened Feb 22, 2026 by harshang03 • Draft
1
1
fix: keep fp32-pinned parameters out of the bf16 cast path in ZeRO-3 (#7747)
#7867 opened Feb 22, 2026 by harshang03 • Draft
1
Revert "fix: remove premature MPI environment variable check in OpenMPIRunner"
#7864 opened Feb 21, 2026 by mikloorbi-sys • Draft
1
Fix global .cuh ignore and enforce tracked CUDA headers
#7858 opened Feb 18, 2026 by harshang03 • Draft
1
ProTip! Add no:assignee to see everything that’s not assigned.