vllm
1bf3997e
- [Quantization] Bound peak memory when repacking FP4 MoE weights for Marlin (#47851)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
107 days ago
[Quantization] Bound peak memory when repacking FP4 MoE weights for Marlin (#47851) Signed-off-by: Joe Rowell <joerowell4@gmail.com> Signed-off-by: mgoin <mgoin64@gmail.com> Co-authored-by: mgoin <mgoin64@gmail.com>
References
#47851 - [Quantization] Bound peak memory when repacking FP4 MoE weights for Marlin
Author
joerowell
Parents
29fd6888
Loading