-
Notifications
You must be signed in to change notification settings - Fork 201
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
[Bug] Sparse Attention Backward (
_FLASH_ATTN_BWD_SM90) produces catastrophically wrong gradients on SM90cat-bugReports of incorrect behavior, crashes, regressions, or unexpected results.Reports of incorrect behavior, crashes, regressions, or unexpected results.mod-cutedslCuTeDSL kernels, generated kernels, examples, or related integration work.CuTeDSL kernels, generated kernels, examples, or related integration work.orig-externalReported or requested by an external user, customer, or community contributor.Reported or requested by an external user, customer, or community contributor.Status: Open.[RFE] ✨ SDPA Support Matrix: Blackwell GeForce / DGX Spark (SM120/SM121) — open-source kernels wanted!
cat-featureRequests for new functionality, APIs, examples, or behavior improvements.Requests for new functionality, APIs, examples, or behavior improvements.open-todoOpen work that is ready to be picked up, scheduled, or prioritized.Open work that is ready to be picked up, scheduled, or prioritized.open-unassignedOpen work with no current assignee or clear owner.Open work with no current assignee or clear owner.Status: Open.[RFE] 💫 SDPA Support Matrix: Blackwell Ultra (SM103) — open-source kernels wanted!
cat-featureRequests for new functionality, APIs, examples, or behavior improvements.Requests for new functionality, APIs, examples, or behavior improvements.mod-frontendcuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.cuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.open-todoOpen work that is ready to be picked up, scheduled, or prioritized.Open work that is ready to be picked up, scheduled, or prioritized.open-unassignedOpen work with no current assignee or clear owner.Open work with no current assignee or clear owner.Status: Open.[RFE] 🚀 SDPA Support Matrix: Blackwell (SM100) — open-source kernels wanted!
cat-featureRequests for new functionality, APIs, examples, or behavior improvements.Requests for new functionality, APIs, examples, or behavior improvements.mod-frontendcuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.cuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.open-todoOpen work that is ready to be picked up, scheduled, or prioritized.Open work that is ready to be picked up, scheduled, or prioritized.open-unassignedOpen work with no current assignee or clear owner.Open work with no current assignee or clear owner.Status: Open.[RFE] 🦗 SDPA Support Matrix: Hopper (SM90) — open-source kernels wanted!
cat-featureRequests for new functionality, APIs, examples, or behavior improvements.Requests for new functionality, APIs, examples, or behavior improvements.mod-frontendcuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.cuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.open-todoOpen work that is ready to be picked up, scheduled, or prioritized.Open work that is ready to be picked up, scheduled, or prioritized.open-unassignedOpen work with no current assignee or clear owner.Open work with no current assignee or clear owner.Status: Open.[RFE] ⚡ SDPA Support Matrix: Ampere (SM80) — open-source kernels wanted!
cat-featureRequests for new functionality, APIs, examples, or behavior improvements.Requests for new functionality, APIs, examples, or behavior improvements.mod-frontendcuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.cuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.open-todoOpen work that is ready to be picked up, scheduled, or prioritized.Open work that is ready to be picked up, scheduled, or prioritized.open-unassignedOpen work with no current assignee or clear owner.Open work with no current assignee or clear owner.Status: Open.Can SM90 DSA indexer_forward support qhead_per_kv_head=16
mod-cutedslCuTeDSL kernels, generated kernels, examples, or related integration work.CuTeDSL kernels, generated kernels, examples, or related integration work.orig-externalReported or requested by an external user, customer, or community contributor.Reported or requested by an external user, customer, or community contributor.Status: Open.[feature request] Add blackwell HSTU mha kernel.
mod-cutedslCuTeDSL kernels, generated kernels, examples, or related integration work.CuTeDSL kernels, generated kernels, examples, or related integration work.mod-frontendcuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.cuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.orig-nv-engReported or requested by NVIDIA engineering.Reported or requested by NVIDIA engineering.Status: Open.Kernel dies executing sample 26 (layernorm + ReLU bitmask) after cudnn.pygraph IR rewrite (fd2cdd18)
cat-bugReports of incorrect behavior, crashes, regressions, or unexpected results.Reports of incorrect behavior, crashes, regressions, or unexpected results.mod-frontendcuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.cuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.open-verify-to-closeOpen work with a proposed fix that needs verification before closing.Open work with a proposed fix that needs verification before closing.orig-qaReported or owned by quality assurance, validation, or testing.Reported or owned by quality assurance, validation, or testing.Status: Open.Have nightly pip wheels from develop branch and latest cudnn-backend release
cat-featureRequests for new functionality, APIs, examples, or behavior improvements.Requests for new functionality, APIs, examples, or behavior improvements.cat-infraBuild, packaging, tooling, dependency, release, or repository maintenance work.Build, packaging, tooling, dependency, release, or repository maintenance work.mod-frontendcuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.cuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.orig-nv-engReported or requested by NVIDIA engineering.Reported or requested by NVIDIA engineering.Status: Open.[Feature request] Include CMake config into the package
cat-featureRequests for new functionality, APIs, examples, or behavior improvements.Requests for new functionality, APIs, examples, or behavior improvements.mod-frontendcuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.cuDNN frontend APIs, operation graph construction, plans, and user-facing wrappers.orig-nv-engReported or requested by NVIDIA engineering.Reported or requested by NVIDIA engineering.Status: Open.Tracking: Have cutedsl MoE kernels perf dashboard
cat-featureRequests for new functionality, APIs, examples, or behavior improvements.Requests for new functionality, APIs, examples, or behavior improvements.Status: Open.