llama.cpp
bed0a856 - CUDA: fuse shared experts into MMVQ (#29184)

Commit
2 days ago
CUDA: fuse shared experts into MMVQ (#29184) * CUDA: fuse shared experts into MMVQ * check if buffer is null * move stride_col_dst to fusion args
Author
Parents
Loading