llama.cpp
9ac8c408
- vulkan: rms_norm fusion opportunities (#28024)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
49 days ago
vulkan: rms_norm fusion opportunities (#28024) Support RMS_NORM + MUL + ADD (+ MUL) and RMS_NORM + VIEW + SET_ROWS. Extend ROPE + VIEW + SET_ROWS to support IMROPE. Worth around 4% in gemma4 on my system.
References
#28024 - vulkan: rms_norm fusion opportunities
Author
jeffbolznv
Parents
2092353c
Loading