Skip to content

Commit c9e65c9

Browse files
author
sd109
committed
Fix sampling parameters format
1 parent b0872c1 commit c9e65c9

File tree

1 file changed

+3
-5
lines changed

1 file changed

+3
-5
lines changed

web-app-utils/example_app_vanilla.py

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -30,11 +30,9 @@ def inference(message, history):
3030
"stream": True,
3131
"max_tokens": 1000,
3232
# Parameters requested by HU
33-
"sampling_params": {
34-
"temperature": 0.7,
35-
"top_p": 0.4,
36-
"top_k": 40,
37-
},
33+
"temperature": 0.7,
34+
"top_p": 0.4,
35+
"top_k": 40,
3836
}
3937
response = requests.post(
4038
f"{backend_url}/generate", headers=headers, json=pload, stream=True

0 commit comments

Comments
 (0)