llama.cpp
009b709d - CUDA: fuse adds, fuse add with rms norm (#15631)

Commit
134 days ago
CUDA: fuse adds, fuse add with rms norm (#15631) * CUDA: fused add with rms_norm_mul * Non-broadcast fuse works * Add fused adds * format * Remove n_fuse from template params * Address review comments * Move template inside binbcast
Author
Parents
Loading