These are the dotfiles that I use and live by. Perhaps you will find them useful too!
To install on Linux and MacOS (still a work in progress):
git clone https://github.com/jeremyckahn/dotfiles.git ~/dotfiles
. ~/dotfiles/install.shThis dotfiles repo includes optional configuration for a llama.cpp server running as a systemd service.
Prerequisite: Clone llama.cpp to ~/oss/llama.cpp:
git clone https://github.com/ggml-org/llama.cpp ~/oss/llama.cppllama/llama.ini- Model presets for llama-serverllama/scripts/update-llama.sh- Build and deploy script for llama.cpp updatesllama/etc/systemd/system/llama-server.service- Systemd service unit
-
Install build dependencies (one-time):
make llama.dependencies
-
Clone llama.cpp (if not already done):
git clone https://github.com/ggml-org/llama.cpp ~/oss/llama.cpp -
Install the llama dotfiles (opt-in):
make llama
-
Enable the systemd service:
sudo make llama.setup
-
View service status:
sudo systemctl status llama-server
-
View logs:
sudo journalctl -u llama-server -f
Run the update script to pull the latest code, rebuild with Vulkan, and restart the service:
~/scripts/update-llama.sh