Add enforce_utf8_boundaries option to BpeTrainer#1830
Open
sanderland wants to merge 4 commits intohuggingface:mainfrom
Open
Add enforce_utf8_boundaries option to BpeTrainer#1830sanderland wants to merge 4 commits intohuggingface:mainfrom
sanderland wants to merge 4 commits intohuggingface:mainfrom
Commits
Commits on Jul 22, 2025
- committed
Sander Land - committedSander Land
Commits on Aug 3, 2025
- authored
- committedSander Land
