llama.cpp
687e7789 - CUDA: fuse rms_norm + mul + rope (+ view + set_rows) (#26767)

Commit
5 days ago
CUDA: fuse rms_norm + mul + rope (+ view + set_rows) (#26767) * CUDA: fuse rms_norm + mul + rope (+ view + set_rows) * tests: add broadcast weight case to rms_norm_mul_rope * CUDA: check memory ranges before rms_norm rope fusion * CUDA: check memory ranges in rope set_rows fusion
Author
Parents
Loading