llama.cpp
e773d226
- add optional activation scales to mul_mat and mul_mat_id tensors
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 day ago
add optional activation scales to mul_mat and mul_mat_id tensors
References
#28898 - ggml: support quant scales for fp8 and nvfp4
#29791 - vulkan: add fp8 and scaled matmul support
Author
0cc4m
Committer
ORippler
Parents
336051a3
Loading