Loading GGUF files support #30391
younesbelkada
merged
37 commits into
huggingface:main
from
LysandreJik:gguf-support
Adds support for loading GGUF files
fb00288f
add q2_k q3_k q5_k support from @99991
81e43241
fix tests
8a0d5b88
Update doc
08534f34
Style
ebd9944d
Docs
5c913ecc
Merge remote-tracking branch 'upstream/main' into HEAD
8b81bfb7
fix CI
c49f1a8d
younesbelkada
commented
on 2024-04-22
Update docs/source/en/gguf.md
7fa538b3
younesbelkada
commented
on 2024-04-22
Update docs/source/en/gguf.md
54853277
Merge branch 'main' into gguf-support
074f05eb
Compute merges
ca8363e8
Merge branch 'main' into gguf-support
2a0c9b01
Merge branch 'main' into gguf-support
fac7bb3b
Merge remote-tracking branch 'upstream/main' into HEAD
45983db5
change logic
e6c6f6ce
add comment for clarity
a6cd08ce
add comment for clarity
66118772
Update src/transformers/models/auto/tokenization_auto.py
455163be
change logic
42d5815e
Update src/transformers/modeling_utils.py
1d3acecd
change
af3c42ca
Merge branch 'gguf-support' of https://github.com/lysandrejik/transfo…
a27db0cf
Apply suggestions from code review
14ad10c2
Update src/transformers/modeling_gguf_pytorch_utils.py
ab621a74
put back comment
207820a7
add comment about mistral
1fef8ad0
comments and added tests
9ae7363c
fix merge
3ed384fd
fix unconsistent type
55eb860c
more
f7543353
Merge remote-tracking branch 'origin/main' into HEAD
a4490787
fix tokenizer
3bdbb2e2
ArthurZucker
approved these changes
on 2024-05-15
Update src/transformers/modeling_utils.py
0ab79f68
address comments about tests and tokenizer + add added_tokens
65433c40
from_gguf -> gguf_file
1b5ae547
replace on docs too
d6b67c6e
ArthurZucker
commented
on 2024-05-15
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub