llama.cpp
8060c074
- ggml: add tensor scaling (per-tensor, per-channel, per-expert, per-expert-per-channel) support
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
20 hours ago
ggml: add tensor scaling (per-tensor, per-channel, per-expert, per-expert-per-channel) support
References
#28898 - ggml: support quant scales for fp8 and nvfp4
#29791 - vulkan: add fp8 and scaled matmul support
Author
0cc4m
Committer
ORippler
Parents
fd3d4118
Loading