Large Language Model app for Open OnDemand. Runs Llama.cpp and connects to the bundled web UI.
Requires the ood-llm-aux repo to be installed.
Requires OOD version 3.1.0 or greater.
-
Notifications
You must be signed in to change notification settings - Fork 3
About Fox Open Ondemand module to serve local LLMs
License
unioslo/fox-ood-llm
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
About Fox Open Ondemand module to serve local LLMs
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published