is there any quantized models for Qwen2.5-VL

[aabbccddwasd]

FP16 version is impossible to run on local GPU, I hope there will be GPTQ and AWQ versions, please!!!

[ShuaiBai623]

The quantized models for Qwen2.5-VL are coming soon.

[aabbccddwasd]

The quantized models for Qwen2.5-VL are coming soon.

thanks！！ How soon， 1 week or 1 month？

[devops724]

add vllm support Qwen2.5-VL too, please

[aabbccddwasd]

add vllm support Qwen2.5-VL too, please

well, I think vllm developers is responsible for this. they said v0.7.2 will support qwen2.5-vl.