PR #31175 Add Qwen2 GGUF loading support

Add Qwen2 GGUF loading support #31175

amyeroberts merged 9 commits into huggingface:main from Isotr0py:gguf

add qwen2 gguf support

53c12213

Update docs

c134d021

fix qwen2 tokenizer

638ca42a

add qwen2 gguf test

f0355364

fix typo in qwen2 gguf test

d3241f9f

format code

e7581127

younesbelkada commented on 2024-06-03

Remove mistral, clarify the error message

b8065ada

younesbelkada approved these changes on 2024-06-03

format code

cf5e14e8

younesbelkada requested a review from

amyeroberts 1 year ago

amyeroberts approved these changes on 2024-06-03

add typing and update docstring

48bdb5e1

amyeroberts merged e4628434 into main 1 year ago

Isotr0py deleted the gguf branch 1 year ago

Reviewers

amyeroberts

younesbelkada

Assignees

No one assigned

Labels

None yet

Milestone

No milestone