Add Gemma2 GGUF support #34002
LysandreJik
merged
17 commits into
huggingface:main
from
yijun-lee:feat/gemma2-gguf
initial setup for ggml.py
532c5cd8
initial setup of GGUFGemma2Converter class
45754bf7
Add gemma2 model to gguf.md doc
7348f303
Partial work on GGUF_TENSOR_MAPPING
171ccb6a
initial setup of GGUF_TENSOR_MAPPING for Gemma2
3672fd7b
Resolved merge conflicts
52f4b16e
refactor: rename GemmaConvert class to GemmaConverter for naming cons…
939ef7fc
Merge branch 'main' into feat/gemma2-gguf
30d627fc
feat: complete gemma2 tensor mapping implementation
adfcdbf1
feat: add initial implementation of GGUFGemmaConverter
6c840a50
feat: complete GGUFGemmaConverter implementation
6b2179a3
feat: add test code for gemma2
6b7c76f9
Merge branch 'main' into feat/gemma2-gguf
c4f06e02
refactor: minor code cleanup
d487b5db
refactor: minor code cleanup
d3f00e0d
SunMarc
commented
on 2024-12-30
fix: resolve suggestions
fd58f457
Isotr0py
commented
on 2025-01-02
Update tests/quantization/ggml/test_ggml.py
48a3b2b0
SunMarc
approved these changes
on 2025-01-02
LysandreJik
approved these changes
on 2025-01-03
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub