vllm
1bf3997e - [Quantization] Bound peak memory when repacking FP4 MoE weights for Marlin (#47851)

Commit
107 days ago
[Quantization] Bound peak memory when repacking FP4 MoE weights for Marlin (#47851) Signed-off-by: Joe Rowell <joerowell4@gmail.com> Signed-off-by: mgoin <mgoin64@gmail.com> Co-authored-by: mgoin <mgoin64@gmail.com>
Author
Parents
Loading