[Model request] DeepSeek benchmark

[Zeno-kimono]

Model name

Which model should we test?
DeepSeek-v3

Parameters

Are there any specific parameters that should be included in the test matrix?

Source

Where can we find the model? What is the framework (e.g., torch, ggufv2)?
https://github.com/[deepseek-ai/DeepSeek-V3](https://github.com/deepseek-ai/DeepSeek-V3)

Support

Can you help, e.g., by filing a pull request?

Hello, I am a new user and came across your recently published Nature Biotechnology paper(Congrats!!). I am curious to know if it’s possible use the DeepSeek API. So, could you also run a test on its benchmark performance, particularly on biomedical tasks, compared to other popular models like ChatGPT or Claude?

[slobentanzer]

@Zeno-kimono many thanks for the request, DeepSeek is a very interesting candidate; will put it on the list!