llama.cpp
4a763a43
- Guard __nv_cvt_fp8x2_to_bf162raw on CTK 13.2
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 day ago
Guard __nv_cvt_fp8x2_to_bf162raw on CTK 13.2 Fixes https://github.com/ggml-org/llama.cpp/pull/28413#discussion_r4044500099
References
#28413 - CUDA: Add OCP FP8 support
#28898 - ggml: support quant scales for fp8 and nvfp4
#29791 - vulkan: add fp8 and scaled matmul support
Author
ORippler
Committer
ORippler
Parents
e907f6ad
Loading