llama.cpp
799fc226 - CUDA: Faster Mixtral prompt processing (#4538)

Commit
1 year ago
CUDA: Faster Mixtral prompt processing (#4538) * CUDA: make MoE tensors contiguous for batch size>1 * Update ggml-cuda.cu Co-authored-by: slaren <slarengh@gmail.com> --------- Co-authored-by: slaren <slarengh@gmail.com>
Parents
Loading