llama3.1 (and other models) support

[ekk1]

Hi,

Thank you for this fantastic repository. I am relatively new to AI and C, but I am quite interested in modifying this project to support newer models like Llama 3.1 and Mistral Nemo.

I have examined the differences between this project and the original llama2.c. Could you point me to any relevant materials, code samples, or documentation that might help me understand what changes are necessary?

Thank you very much for your assistance.

Best regards.

[ryao]

This llama2.c fork has llama 3.1 support:

https://github.com/trholding/llama2.c