llama.cpp
9ac8c408 - vulkan: rms_norm fusion opportunities (#28024)

Commit
49 days ago
vulkan: rms_norm fusion opportunities (#28024) Support RMS_NORM + MUL + ADD (+ MUL) and RMS_NORM + VIEW + SET_ROWS. Extend ROPE + VIEW + SET_ROWS to support IMROPE. Worth around 4% in gemma4 on my system.
Author
Parents
Loading