Proposal: Support for InternVLChatModel in llama.cpp

[manwallet]

Hello llama.cpp community,

I am proposing an enhancement to the llama.cpp project to add support for the InternVLChatModel architecture. During the model conversion process using the convert_hf_to_gguf.py script, I encountered an error indicating that this specific model architecture is not yet supported.

Background:

• Model: InternVLChatModel
• Error: The script currently returns an error stating the model is not supported during the conversion process.
• Use Case: This model architecture is part of our ongoing research and has potential applications in advanced conversational AI systems.

Motivation:

• Adding support for InternVLChatModel would greatly enhance the flexibility and applicability of llama.cpp in handling a wider range of state-of-the-art models.
• It broadens the utility of the tool, making it more attractive for users and developers working with modern architectures in AI.

Request:

• I would appreciate insights from the community on how we might achieve this support.
• If there are ongoing efforts or ideas on how to extend the existing conversion capabilities to include InternVLChatModel, please share your thoughts.

Additional Information:

• Any advice on potential implementation approaches or necessary modifications would be welcomed.
• References or documentation regarding the model's internal structure could be beneficial for the discussion.

Thank you for considering this proposal. I look forward to collaborating with the community to explore the feasibility of this enhancement.