Merge remote-tracking branch 'origin/master' into fix-cuda-cublas-qua…
76be1389
JonSnow1807
changed the title CUDA: use an fp32 result for quantized src0 in the cuBLAS fallback CUDA: keep the MUL_MAT_ID precision in the per-expert fallback9 days ago
CUDA: keep the MUL_MAT_ID precision in the per-expert fallback
c61aba2b
JonSnow1807force pushedfrom523524ebtoc61aba2b9 days ago
Login to write a write a comment.
Login via GitHub