Skip to content

Add sparse text and document embedders to the vLLM integration #4160

Open
deepset-ai/haystack
#13445

Description

@maxdswain

Is your feature request related to a problem? Please describe.
The vLLM integration only provides dense embedders. Using vLLM-hosted sparse models requires custom components.

Describe the solution you'd like
Add:

  • VLLMSparseTextEmbedder: returns a SparseEmbedding for a string.
  • VLLMSparseDocumentEmbedder: populates each document’s sparse_embedding field.

Support sync and async execution, with configuration consistent with the existing vLLM embedders.

Describe alternatives you've considered
Custom components or existing sparse embedders that require a different inference backend.

Additional context
N/A

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions