[CUDA] : Add SKU-aware FP16/BF16 accumulation precision gating for NVIDIA GPUs #30672
cuda: select cuBLAS precision by GPU SKU
df576a6c
mmalpe-nv
changed the title cuda: select cuBLAS precision by GPU SKU [CUDA]: select cuBLAS precision by GPU SKU 33 days ago
mmalpe-nv
changed the title [CUDA]: select cuBLAS precision by GPU SKU [CUDA] : Add SKU-aware FP16/BF16 accumulation precision gating for NVIDIA GPUs 33 days ago
mmalpe-nv
marked this pull request as ready for review 28 days ago
cuda: fix remaining GB10 macro reference
600c5b53
cuda: review comment addressed, store accumulation preference in devi…
036d8e7e
Apply batched suggestions from code review
1aaad3d2
Merge branch 'master' of https://github.com/ggml-org/llama.cpp into m…
055b33a5
addressed Oliver's comment regarding initialize NVML once and install…
cf256c2d
merge master and update GB10 references and NVML setup
3d53d4a3
move precision selection helper into init
ca834154
ORippler
approved these changes
on 2026-11-18
ORippler
merged
2cbfc3cf
into master 8 hours ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub