transformers
e15ea9b9 - Keep MXFP4 weights quantized on XPU when use_kernels is set (#47923)

Commit
2 days ago
Keep MXFP4 weights quantized on XPU when use_kernels is set (#47923) The megablocks XPU kernel consumes MXFP4 experts natively, so dequantizing to bf16 only costs memory and bandwidth. Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
Author
Parents
Loading