llama.cpp
ad6c6683 - ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846)

Commit
24 days ago
ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846) * ggml-cuda: fallback to F32 on device without BF16 hardware acceleration: (Nvidia >= AMPERE, AMD >= RDNA3 or = CDNA) * apply logic to NVIDIA as well --------- Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
Parents
Loading