New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

deepseek7b模型加载速度疑惑 #91

Open

wcool1 opened this issue Feb 27, 2025 · 0 comments

wcool1 commented Feb 27, 2025 •

edited

Loading

您好，按照本仓库文档配置环境，运行deepseek-r1-distill-qwen-7b模型加载平均用时在80-90s，这正常吗；有没有什么办法提升?另外画框部分是什么原因导致的，正常吗？
设备：AIBox1684x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment