llama.cpp
5eff6ec9 - CUDA: MoE helper in device code, better tile sizes (#15525)

Commit

131 days ago

CUDA: MoE helper in device code, better tile sizes (#15525) * CUDA: MoE helper in device code, better tile sizes * reduce superfluous CUDA blocks

References

Author

JohannesGaessler

Parents