vllm
[Bugfix] Fix new Llama3.1 GGUF model loading
#7269

Merged

[Bugfix] Fix new Llama3.1 GGUF model loading #7269

simon-mo merged 2 commits into vllm-project:main from Isotr0py:gguf-llama3.1

fix gguf rope_freqs handling

7331a1a2

github-actions added ready

code format

6766d65a

mgoin approved these changes on 2024-08-08

njhill approved these changes on 2024-08-08

simon-mo merged 8334c39f into main 1 year ago

Isotr0py deleted the gguf-llama3.1 branch 1 year ago

Reviewers

njhill

mgoin

Assignees

No one assigned

Labels

ready

Milestone

No milestone