Skip to content

Can SM90 DSA indexer_forward support qhead_per_kv_head=16 #373

Description

@xiaoxi-wangfj

Hi, I have a question about the DSA cuDNN frontend implementation.

In cudnn-frontend/python/cudnn/deepseek_sparse_attention/indexer_forward/_interface_sm90.py
the SM90 indexer_fwd path currently defines:

_SUPPORTED_QHPKV = (32, 64)
So qhead_per_kv_head=16 is rejected.

I’d like to ask whether the underlying operator implementation can support qhead_per_kv_head=16.

Metadata

Metadata

Assignees

No one assigned

    Labels

    cat-enhancementsmod-cutedslCuTeDSL kernels, generated kernels, examples, or related integration work.orig-externalReported or requested by an external user, customer, or community contributor.

    Fields

    No fields configured for Enhancement.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions