Skip to content

Pull requests: huggingface/trl

New pull request New
78 Open 2,379 Closed
78 Open 2,379 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add uv/hf jobs support to OpenEnv scripts
#4720 opened Dec 18, 2025 by sergiopaniego Loading…
5 tasks
1
RLOO supports async rewards.
#4718 opened Dec 18, 2025 by pramodith Loading…
5 tasks done
8
Refactor vLLM generation [3/N]: Decouple profiling from trainer
#4717 opened Dec 18, 2025 by albertvillanova • Draft
Disallow PeftModel + peft_config in trainers
#4713 opened Dec 17, 2025 by qgallouedec Loading…
2
Refactor vLLM generation [2/N]: Decouple rollout_func and vLLM functionalities
#4712 opened Dec 17, 2025 by albertvillanova Loading…
1
Fix: handle multiple tool calls in qwen3_schema
#4709 opened Dec 17, 2025 by mattbui Loading…
3 of 4 tasks
1
4
Refactor vLLM generation [1/N]: Extract vLLM generation
#4700 opened Dec 16, 2025 by albertvillanova Loading…
14
fix: invalidate ZeRO-3 param coordinator trace in add_hooks
#4693 opened Dec 15, 2025 by roycho96 Loading…
1 of 5 tasks
@kashif
6
feat: DeepSeek V3.2 Off-policy sequence masking
#4689 opened Dec 13, 2025 by casinca Loading…
4 of 5 tasks
1
10
GKDTrainer: Fix return_outputs in Liger kernel path and update tests
#4688 opened Dec 13, 2025 by roycho96 Loading…
2 of 5 tasks
2
loss calculation for evaluation without training
#4673 opened Dec 11, 2025 by SonuDixit Loading…
5 tasks
Update import structure
#4665 opened Dec 11, 2025 by qgallouedec • Draft
Add GRPO QLoRA free notebook
#4660 opened Dec 10, 2025 by sergiopaniego • Draft
5 tasks
[WIP] GRPO-inspired Online DPO refactor
#4659 opened Dec 10, 2025 by d-tiapkin • Draft
2 of 7 tasks
@kashif
feature: Add RTPO Trainer
#4652 opened Dec 9, 2025 by SolarWindRider Loading…
6 tasks done
6
CPOTrainer - Incorrect handling of different length chosen/rejected p…
#4639 opened Dec 8, 2025 by davmels Loading…
Update docs landing with latest details
#4624 opened Dec 4, 2025 by sergiopaniego Loading…
6 tasks
1
Add cross-tokenizer distillation support for GKD and MiniLLM trainers
#4561 opened Nov 22, 2025 by sambhavnoobcoder Loading…
1
Add PSPO trust region method as alternative to clipping in GRPOTrainer
#4548 opened Nov 19, 2025 by MCDwyer Loading…
2 of 5 tasks
@kashif
4
Add compute_metrics parameter for GRPOTrainer
#4534 opened Nov 17, 2025 by colinzhaoxp Loading…
3
[GRPO] switch grpo liger loss to triton version
#4519 opened Nov 13, 2025 by kashif Loading…
1 of 8 tasks
10
adding [SimPER](https://arxiv.org/abs/2502.00883)
#4486 opened Nov 6, 2025 by leeparkuky Loading…
2 of 5 tasks
1
docs: Unify model examples to use trl-lib namespace
#4431 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
Use explicit tiny-Qwen2ForCausalLM-2.5 model_id param in CI tests
#4331 opened Oct 23, 2025 by albertvillanova Loading…
4
refactor: simplify parameter freezing in modeling_base.py
#4305 opened Oct 20, 2025 by Ki-Seki Loading…
2 of 5 tasks
2
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.