Skip to content

Fix chatml fallback for unsupported builtin templates (when --jinja not enabled) #11533

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 31, 2025

Conversation

ochafik
Copy link
Collaborator

@ochafik ochafik commented Jan 31, 2025

Fixes #11500 & #11400 (regression introduced by #11016 )

cc/ @cgruver

@ochafik ochafik marked this pull request as ready for review January 31, 2025 00:48
@ochafik ochafik requested a review from ngxson as a code owner January 31, 2025 00:48
@ochafik ochafik added bugfix fixes an issue or bug merge ready indicates that this may be ready to merge soon and is just holding out in case of objections labels Jan 31, 2025
@ochafik ochafik merged commit 5783575 into ggml-org:master Jan 31, 2025
44 of 45 checks passed
@ochafik ochafik deleted the fix-chatml-fallback branch January 31, 2025 08:55
tinglou pushed a commit to tinglou/llama.cpp that referenced this pull request Feb 13, 2025
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Feb 26, 2025
mglambda pushed a commit to mglambda/llama.cpp that referenced this pull request Mar 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bugfix fixes an issue or bug examples merge ready indicates that this may be ready to merge soon and is just holding out in case of objections server
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Eval bug: Release b4524 breaks serving of granite-code models
2 participants