Skip to content

Commit a625047

Browse files
Update Flash Attention to use processHeadsFlashAttentionOptV2
1 parent 65414f2 commit a625047

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/main/java/org/beehive/gpullama3/tornadovm/layers/type/fp16/Qwen3FP16FFNLayers.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -288,7 +288,7 @@ protected TaskGraph createFFNLayerTaskGraph(int layerIndex) {
288288

289289
// Flash Attention
290290
unifiedLayer.task("attention",
291-
TransformerComputeKernelsLayered::processHeadsFlashAttention,
291+
TransformerComputeKernelsLayered::processHeadsFlashAttentionOptV2,
292292
context,
293293
qwen3State.wrapQ, // query vectors
294294
qwen3State.wrapKeyCache, // key cache

0 commit comments

Comments
 (0)