llama.cpp
b4e335d8
- vulkan: fuse rms_norm + mul + rope (+ view + set_rows) (#16977)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 day ago
vulkan: fuse rms_norm + mul + rope (+ view + set_rows) (#16977) This change combines the rms_norm+mul and rope+view+set_rows fusions to allow fusing the whole sequence together. This comes up in Qwen3, Bailing, and some other models.
References
#16977 - vulkan: fuse rms_norm + mul + rope (+ view + set_rows)
Author
jeffbolznv
Parents
d6fe40fa
Loading