Skip to content

simple web interface to manage systemD service for llama.cpp

Notifications You must be signed in to change notification settings

Nurb4000/llama_web_interface

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

For those of us who use llama.cpp as a service on Debian, got tired of editing and restarting the service by hand if i wanted to change the model, so this made it easier.

Shows you what is running now, what local models are available, lets you swap it out for a new model and restart the service.

Just python and flask and nothing fancy, hard coded folder paths, so update as needed for your enviroment.

About

simple web interface to manage systemD service for llama.cpp

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published