Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Picture understanding The setting of the maximum token number output is useless, no matter how you change it, it is the default 800 #2353

Open
chenslcool opened this issue Feb 21, 2025 · 2 comments
Assignees

Comments

@chenslcool
Copy link

Contact Information

No response

MaxKB Version

1.10

Problem Description

高级编排->图片理解,设置输出最大token数为65536,在后端查看vllm的log,发现max token请求参数是800,改成10的话,也是800。
大语言模型没这个问题

Steps to Reproduce

高级编排->图片理解,设置输出最大token数为65536,在后端查看vllm的log,发现max token请求参数是800,改成10的话,也是800。
大语言模型没这个问题

The expected correct result

max token能被设置为高级编排中的设置值

Related log output

Additional Information

No response

@shaohuzhang1 shaohuzhang1 changed the title [Bug] 图片理解 输出最大token数设置没用,怎么改都是默认的800 [Bug] Picture understanding The setting of the maximum token number output is useless, no matter how you change it, it is the default 800 Feb 21, 2025
@chenslcool
Copy link
Author

暂时没有版本更新的话,有没有办法源码改一下?

@shaohuzhang1
Copy link
Contributor

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


If there is no version update for the time being, is there any way to change the source code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants