llama.cpp
2cbfc3cf - [CUDA] : Add SKU-aware FP16/BF16 accumulation precision gating for NVIDIA GPUs (#30672)

Commit
8 hours ago
[CUDA] : Add SKU-aware FP16/BF16 accumulation precision gating for NVIDIA GPUs (#30672) * cuda: select cuBLAS precision by GPU SKU Assisted-by: Codex * cuda: fix remaining GB10 macro reference * cuda: review comment addressed, store accumulation preference in device info * Apply batched suggestions from code review Co-authored-by: Johannes Gäßler <johannesg@5d6.de> * addressed Oliver's comment regarding initialize NVML once and install headers in Windows CI * move precision selection helper into init --------- Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
Author
Parents
Loading