vllm

[Bugfix] Fix new Llama3.1 GGUF model loading

#7269

Merged