llama.cpp
b4e335d8 - vulkan: fuse rms_norm + mul + rope (+ view + set_rows) (#16977)

Commit
1 day ago
vulkan: fuse rms_norm + mul + rope (+ view + set_rows) (#16977) This change combines the rms_norm+mul and rope+view+set_rows fusions to allow fusing the whole sequence together. This comes up in Qwen3, Bailing, and some other models.
Author
Parents
Loading