llama.cpp port to pure Golang #919
gotzmann
started this conversation in
Show and tell
Replies: 3 comments
-
Congrats! Looks like great effort and very well done! |
Beta Was this translation helpful? Give feedback.
0 replies
-
pure golang is create ! golang is easy to use . |
Beta Was this translation helpful? Give feedback.
0 replies
-
@gotzmann |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I've released the framework I have been building for the last month.
It's the like 1:1 port of llama.cpp to pure Go, where the language really shines due to easier multi-threading model and channels.
Not so performant and memory savvy as original one but I hope it would be useful for those who'd like to grok with ChatGPT-like projects with Go:)
Beta Was this translation helpful? Give feedback.
All reactions