Skip to content

ManagedCollisionEmbeddingBagCollectionSharder cannot support CPU #2958

@YuandongXu-hotstar

Description

@YuandongXu-hotstar

Does ManagedCollisionEmbeddingBagCollectionSharder only support cuda?
I want to use ManagedCollisionEmbeddingBagCollection in CPU only environment.
But I cannot resolve the "RuntimeError: No available sharding type and compute kernel combination after applying user provided constraints for XXX"
What should I do?

for shard types that each sharder supports in CPU device type:
EmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise']
FeatureProcessedEmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise']
EmbeddingCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'row_wise']
FusedEmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise']
QuantEmbeddingBagCollectionSharder: ['table_wise', 'row_wise', 'column_wise']
QuantEmbeddingCollectionSharder: ['table_wise', 'row_wise', 'column_wise']
ManagedCollisionEmbeddingBagCollectionSharder: [] ----------------------> this is empty list
ManagedCollisionEmbeddingCollectionSharder: ['row_wise']
QuantManagedCollisionEmbeddingCollectionSharder: ['row_wise']

Can I use EmbeddingBagCollectionSharder when I use ManagedCollisionEmbeddingBagCollection for the embeddings? What would be the behavior?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions