You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
shaohuzhang1
changed the title
[Bug] 图片理解 输出最大token数设置没用,怎么改都是默认的800
[Bug] Picture understanding The setting of the maximum token number output is useless, no matter how you change it, it is the default 800
Feb 21, 2025
Contact Information
No response
MaxKB Version
1.10
Problem Description
高级编排->图片理解,设置输出最大token数为65536,在后端查看vllm的log,发现max token请求参数是800,改成10的话,也是800。
大语言模型没这个问题
Steps to Reproduce
高级编排->图片理解,设置输出最大token数为65536,在后端查看vllm的log,发现max token请求参数是800,改成10的话,也是800。
大语言模型没这个问题
The expected correct result
max token能被设置为高级编排中的设置值
Related log output
Additional Information
No response
The text was updated successfully, but these errors were encountered: