Support transfomers v5

Transformers v5 breaks lots of things in Fast-LLM, see https://github.com/ServiceNow/Fast-LLM/actions/runs/21375524204/job/61530597542?pr=460

We currently restrict the version #461, but should work on addressing these issues.