Skip to content

Can't load phi-2 model #429

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Camel-RD opened this issue Jan 11, 2024 · 1 comment
Closed

Can't load phi-2 model #429

Camel-RD opened this issue Jan 11, 2024 · 1 comment

Comments

@Camel-RD
Copy link

Im trying to load this file dolphin-2_6-phi-2.Q5_K_M.gguf
and LLamaWeights.LoadFromFile throws this exception:

System.AccessViolationException
HResult=0x80004003
Message=Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
Source=
StackTrace:

@martindevans
Copy link
Member

martindevans commented Jan 12, 2024

Support for Phi2 was added to llama.cpp quite recently, we'll need to update the binaries that we distribute to include support. This is being tracked in #381 :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants