PR #33437 Add falcon gguf

Add falcon gguf #33437

LysandreJik merged 9 commits into huggingface:main from g-prz:add-falcon-gguf

g-prz force pushed 1 year ago

g-prz marked this pull request as ready for review 1 year ago

feat(gguf): add falcon q2 k

7b5a2bfb

fix(gguf): remove useless renaming

88be26d5

feat(gguf): seperate falcon 7b and 40b

eb956754

feat(gguf): apply fixup

1fbccf61

g-prz force pushed to 1fbccf61 1 year ago

fix(test): error rebase

5ed82b12

feat(gguf): add fp16 weight comparison for falcon

e6cf8728

g-prz commented on 2024-10-01

feat(gguf): test weight of all layers

8492d004

SunMarc requested a review from

LysandreJik 1 year ago

SunMarc approved these changes on 2024-10-01

test(gguf): add falcon 40b under skip decorator

124f3429

feat(gguf): quick example for extracting model size

4b3b4499

LysandreJik approved these changes on 2024-10-02

LysandreJik merged fe484726 into main 1 year ago

Reviewers

LysandreJik

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone