Skip to content

Commit 738d7f2

Browse files
committed
[Feat]: Add support for kleidiai quantization schemes
Description: 1. Allow Int4WeightOnlyQuantizer to work with channelwise and groupwise symmetric quantization schemes 2. KleidiAI supports channelwise and 32 groupwise quantized matmul kernels Signed-off-by: Nikhil Gupta <[email protected]>
1 parent 2e032c6 commit 738d7f2

File tree

2 files changed

+354
-60
lines changed

2 files changed

+354
-60
lines changed

0 commit comments

Comments
 (0)