llama.cpp
ggml: add Q2_0 quantization support (CPU)
#24448
Merged

ggml: add Q2_0 quantization support (CPU) #24448

khosravipasha
khosravipasha khosravipasha requested a review from ggerganov ggerganov 126 days ago
khosravipasha khosravipasha requested a review from CISC CISC 126 days ago
github-actions github-actions added testing
github-actions github-actions added examples
github-actions github-actions added python
github-actions github-actions added ggml
bri-prism
CISC
khosravipasha
CISC
max-krasnyansky
max-krasnyansky approved these changes on 2026-06-27
khosravipasha khosravipasha force pushed from dc7c932c 109 days ago
github-actions github-actions added conversion
khosravipasha
max-krasnyansky
khosravipasha
khosravipasha Add Q2_0 quantization: type definition and CPU backend
ed93eda0
khosravipasha khosravipasha force pushed to ed93eda0 101 days ago
khosravipasha
cfournel
max-krasnyansky
ggerganov
ggerganov approved these changes on 2026-07-07
max-krasnyansky max-krasnyansky merged bec4772f into master 99 days ago
Green-Sky
ValdikSS
khosravipasha
ggerganov
khosravipasha
khosravipasha khosravipasha deleted the pr/q2_0-cpu branch 50 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone