llama.cpp
bed0a856
- CUDA: fuse shared experts into MMVQ (#29184)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 days ago
CUDA: fuse shared experts into MMVQ (#29184) * CUDA: fuse shared experts into MMVQ * check if buffer is null * move stride_col_dst to fusion args
References
#29184 - CUDA: fuse shared experts into MMVQ
Author
am17an
Parents
4ebdf2c7
Loading