Integrating this into other projects

[Kenzogithubs]

Hi, very cool project! I was wondering if it's possible to integrate this into a game? I want to run an LLM locally inside of my game with a specific model, would I be able to do that?

[dreaming-panda]

That could be interesting!

Do you need any specific help, e.g., support certain GPUs, LLMs or require further optimization?