Skip to content

Commit 5d13434

Browse files
ochafikmglambda
authored andcommitted
server: support add_generation_prompt query param (ggml-org#12062)
1 parent 7ea902a commit 5d13434

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/server/utils.hpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -598,7 +598,7 @@ static json oaicompat_completion_params_parse(
598598
inputs.tool_choice = common_chat_tool_choice_parse_oaicompat(json_value(body, "tool_choice", std::string("auto")));
599599
inputs.json_schema = json_schema.is_null() ? "" : json_schema.dump();
600600
inputs.grammar = grammar;
601-
inputs.add_generation_prompt = true;
601+
inputs.add_generation_prompt = json_value(body, "add_generation_prompt", true);
602602
inputs.use_jinja = use_jinja;
603603
inputs.parallel_tool_calls = json_value(body, "parallel_tool_calls", false);
604604
inputs.extract_reasoning = reasoning_format != COMMON_REASONING_FORMAT_NONE;

0 commit comments

Comments
 (0)