Need help to understand make_qkx2_quants #3140

Unanswered

alexmaruichen asked this question in Q&A

alexmaruichen
Sep 12, 2023

I am quite confused with the new quantization method adopted from #2707 . Is there any detailed information on the new function or someone may kindly explain it?
https://github.com/ggerganov/llama.cpp/blob/89e89599fd095172f8d67903b5e227467420f036/k_quants.c#L245-L319

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment