Skip to content

Commit f486267

Browse files
committed
Add support for gemma4
1 parent 2029c74 commit f486267

1 file changed

Lines changed: 3 additions & 0 deletions

File tree

llamathinkingsectionparser.cpp

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,9 @@ void ThinkingSectionParser::setTokensFromServerProps(const LlamaCppServerProps &
1111
if (serverProps.model_path.contains("gpt-oss", Qt::CaseInsensitive)) {
1212
m_startToken = "<|channel|>analysis<|message|>";
1313
m_endToken = "<|end|>";
14+
} else if (serverProps.model_path.contains("gemma", Qt::CaseInsensitive)) {
15+
m_startToken = "<|channel>";
16+
m_endToken = "<channel|>";
1417
} else {
1518
// Tested with DeepSeek.
1619
m_startToken = "<think>";

0 commit comments

Comments
 (0)