Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
create-preference-data-ollama.ipynb		create-preference-data-ollama.ipynb
dpo-from-scratch.ipynb		dpo-from-scratch.ipynb
instruction-data-with-preference.json		instruction-data-with-preference.json
previous_parts.py		previous_parts.py

README.md

Part 6: Finetuning to Follow Instructions

create-preference-data-ollama.ipynb: A notebook that creates a synthetic dataset for preference finetuning dataset using Llama 3.1 and Ollama
dpo-from-scratch.ipynb: This notebook implements Direct Preference Optimization (DPO) for LLM alignment