RMAIIG LMQL Demo

Demo code for the March 19, 2024 RMAIIG Engineering Meetup

This project contains some simple examples of using LMQL to constrain output from LLMs.

Getting started

Define required environment variables - These examples assume that OPENAI_API_KEY contains a valid OpenAI API Key, and that CMAKE_ARGS is configured properly to build llama-cpp-python. If you have your shell configured to use .env files, adapt env-example.
Install required packages - Run poetry install to install all of the software packages required to run the demos.
Test LMQL Installation - Run lmql playground and try some of the examples on the web page that comes up to ensure that everything is installed and configured correctly.
Launch Notebooks - Open the notebooks in your Jupyter Notebook editor of choice. Note that the last three notebooks will download and install some model files locally, requiring about 10GB of space total.

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
llama2		llama2
lmql_demo		lmql_demo
.gitignore		.gitignore
00_intro.ipynb		00_intro.ipynb
01_jokes.lmql		01_jokes.lmql
02_jokes-sample.lmql		02_jokes-sample.lmql
02_knock-knock.lmql		02_knock-knock.lmql
03_summarization.ipynb		03_summarization.ipynb
04_llama-cpp.ipynb		04_llama-cpp.ipynb
05_distribution.ipynb		05_distribution.ipynb
06_multiple-choice.ipynb		06_multiple-choice.ipynb
Readme.md		Readme.md
env-example		env-example
poetry.lock		poetry.lock
pyproject.toml		pyproject.toml