Skip to content

Commit 6d66d6d

Browse files
authored
feat(model_providers): Support deepseek-r1 for Nvidia Catalog (#13269)
Signed-off-by: -LAN- <[email protected]>
1 parent 03ec351 commit 6d66d6d

File tree

3 files changed

+37
-1
lines changed

3 files changed

+37
-1
lines changed

api/core/model_runtime/model_providers/nvidia/llm/_position.yaml

+1
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,4 @@
1+
- deepseek-ai/deepseek-r1
12
- google/gemma-7b
23
- google/codegemma-7b
34
- google/recurrentgemma-2b
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
model: deepseek-ai/deepseek-r1
2+
label:
3+
en_US: deepseek-ai/deepseek-r1
4+
model_type: llm
5+
features:
6+
- agent-thought
7+
model_properties:
8+
mode: chat
9+
context_size: 128000
10+
parameter_rules:
11+
- name: temperature
12+
use_template: temperature
13+
min: 0
14+
max: 1
15+
default: 0.5
16+
- name: top_p
17+
use_template: top_p
18+
min: 0
19+
max: 1
20+
default: 1
21+
- name: max_tokens
22+
use_template: max_tokens
23+
min: 1
24+
max: 1024
25+
default: 1024
26+
- name: frequency_penalty
27+
use_template: frequency_penalty
28+
min: -2
29+
max: 2
30+
default: 0
31+
- name: presence_penalty
32+
use_template: presence_penalty
33+
min: -2
34+
max: 2
35+
default: 0

api/core/model_runtime/model_providers/nvidia/llm/llm.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -83,7 +83,7 @@ def validate_credentials(self, model: str, credentials: dict) -> None:
8383
def _add_custom_parameters(self, credentials: dict, model: str) -> None:
8484
credentials["mode"] = "chat"
8585

86-
if self.MODEL_SUFFIX_MAP[model]:
86+
if self.MODEL_SUFFIX_MAP.get(model):
8787
credentials["server_url"] = f"https://ai.api.nvidia.com/v1/{self.MODEL_SUFFIX_MAP[model]}"
8888
credentials.pop("endpoint_url")
8989
else:

0 commit comments

Comments
 (0)