Skip to content

Commit 58d13e9

Browse files
committed
opencl: add flattened Q4_K mv and general Q4_K mm
1 parent a0bbcdd commit 58d13e9

5 files changed

Lines changed: 734 additions & 4 deletions

File tree

ggml/src/ggml-opencl/CMakeLists.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -89,6 +89,7 @@ set(GGML_OPENCL_KERNELS
8989
mul_mv_q4_1_f32
9090
mul_mv_q4_1_f32_flat
9191
mul_mv_q4_k_f32
92+
mul_mv_q4_k_f32_flat
9293
mul_mv_q6_k_f32
9394
mul_mv_q6_k_f32_flat
9495
mul_mv_q8_0_f32
@@ -107,6 +108,7 @@ set(GGML_OPENCL_KERNELS
107108
mul_mm_q4_0_f32_l4_lm
108109
mul_mm_q4_1_f32_l4_lm
109110
mul_mm_q8_0_f32_l4_lm
111+
mul_mm_q4_k_f32_l4_lm
110112
mul_mm_q6_k_f32_l4_lm
111113
mul_mm_q8_0_f32_8x4
112114
gemv_noshuffle_q4_1_f32

0 commit comments

Comments
 (0)