Skip to content

opencl: split ggml-opencl.cl into multiple files and cleanup #12886

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
max-krasnyansky merged 10 commits into from
Apr 15, 2025
Merged

opencl: split ggml-opencl.cl into multiple files and cleanup #12886

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
32761b8
opencl: refactor - split the kernel files
lhez Mar 29, 2025
a423f7c
opencl: split more kernels into separate files
lhez Mar 30, 2025
a06517e
opencl: specify subgroup size instead of querying it
lhez Mar 31, 2025
5fb23ce
opencl: refine Adreno cl compiler version parsing
lhez Mar 31, 2025
b29328a
opencl: skip some kernels not used by Adreno on old compilers
lhez Mar 31, 2025
8a291af
opencl: refine logic for selecting Adreno kernels
lhez Mar 31, 2025
e4ab469
opencl: refine Adreno cl compiler version
lhez Apr 1, 2025
a4a0c24
opencl: cleanup preprocessor for kernels
lhez Apr 2, 2025
fbd3b4b
opencl: consider Adreno CL compiler on Windows
lhez Apr 9, 2025
9266581
opencl: add final newline for `mul_mv_f16_f16.cl`
lhez Apr 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
45 changes: 35 additions & 10 deletions ggml/src/ggml-opencl/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,16 +54,41 @@ function(ggml_opencl_add_kernel KNAME)
endfunction()

set(GGML_OPENCL_KERNELS
ggml-opencl
ggml-opencl_mm
ggml-opencl_cvt
ggml-opencl_gemv_noshuffle
ggml-opencl_gemv_noshuffle_general
ggml-opencl_mul_mat_Ab_Bi_8x4
ggml-opencl_transpose_16
ggml-opencl_transpose_32
ggml-opencl_transpose_32_16
ggml-opencl_im2col
add
clamp
cpy
cvt
diag_mask_inf
gelu
gemv_noshuffle_general
gemv_noshuffle
get_rows
im2col_f32
im2col_f16
mul_mat_Ab_Bi_8x4
mul_mv_f16_f16
mul_mv_f16_f32_1row
mul_mv_f16_f32_l4
mul_mv_f16_f32
mul_mv_f32_f32
mul_mv_q4_0_f32
mul_mv_q4_0_f32_v
mul_mv_q4_0_f32_8x_flat
mul_mv_q4_0_f32_1d_8x_flat
mul_mv_q4_0_f32_1d_16x_flat
mul_mv_q6_k
mul
norm
relu
rms_norm
rope
scale
silu
softmax_4_f32
softmax_4_f16
softmax_f32
softmax_f16
transpose
)

foreach (K ${GGML_OPENCL_KERNELS})
Expand Down
Loading
Loading