user@91dbdda9c93c:~/app/TokenSelect-main$ bash scripts/serve.sh
2025-03-10 05:43:42,354 - INFO - flashinfer.jit: Prebuilt kernels not found, using JIT backend
Error: No module named 'outlines.fsm.regex'. Please install a new version of outlines by `pip install "outlines>=0.0.44"`
Traceback (most recent call last):
File "/home/user/app/TokenSelect-main/benchmark/serve.py", line 34, in <module>
patch_model(sgl_conf)
File "/home/user/app/TokenSelect-main/benchmark/serve.py", line 12, in patch_model
from patcher.token_retrieval import patch
File "/home/user/app/TokenSelect-main/patcher/token_retrieval.py", line 10, in <module>
from sglang.srt.managers.schedule_batch import ScheduleBatch
File "/home/user/.local/lib/python3.11/site-packages/sglang/srt/managers/schedule_batch.py", line 28, in <module>
from sglang.srt.constrained import RegexGuide
File "/home/user/.local/lib/python3.11/site-packages/sglang/srt/constrained/__init__.py", line 25, in <module>
from outlines.fsm.regex import FSMInfo, make_byte_level_fsm, make_deterministic_fsm
ModuleNotFoundError: No module named 'outlines.fsm.regex'