transformers
MXFP8 on the fine-grained machinery (`Mxfp8Config`)
#49780
Open

MXFP8 on the fine-grained machinery (`Mxfp8Config`) #49780

IlyasMoutawwakil wants to merge 15 commits into fg-split/7-nvfp4 from fg-split/8-mxfp8
IlyasMoutawwakil
IlyasMoutawwakil IlyasMoutawwakil force pushed from a8096024 to 41a18382 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 3afadf9a to 4050b0b2 27 days ago
HuggingFaceDocBuilderDev
IlyasMoutawwakil IlyasMoutawwakil force pushed from 41a18382 to 9f645cd9 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 4050b0b2 to 1986d878 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 9f645cd9 to 55470970 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 0967ed42 to 0af5e23b 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 55470970 to 8319760b 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from b7efdeca to b6d0e7ee 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 0af5e23b to 33ba73d6 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 33ba73d6 to d89fabc6 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from b6d0e7ee to 41a7c021 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from d89fabc6 to 95d3b51f 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 41a7c021 to 120166b6 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 120166b6 to ce74ca49 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 95d3b51f to 45ed0926 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 45ed0926 to d130d741 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from ce74ca49 to 0b31e443 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from d130d741 to fb471e13 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 0b31e443 to 51c59a6a 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from fb471e13 to 40cc59ce 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 51c59a6a to 3dbb2eea 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 3dbb2eea to c90b0193 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 40cc59ce to bfd68ff6 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from c90b0193 to 9d6a4012 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from bfd68ff6 to 165fd890 27 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 165fd890 to c004333a 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 9d6a4012 to 36d20c3d 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 36d20c3d to 8fd92126 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from c004333a to ec9a4cc1 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 8fd92126 to 604540e7 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from ec9a4cc1 to 69c56d49 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 69c56d49 to 5826dbfd 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 604540e7 to 6460949a 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 5826dbfd to cf0866b5 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 6460949a to 43ade9bb 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from cf0866b5 to 828290bf 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 43ade9bb to c622be61 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 828290bf to b2cce819 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from c622be61 to 101228d6 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 101228d6 to 851bff8d 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from b2cce819 to 398f4ada 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from 398f4ada to e08039f9 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 851bff8d to 9246848f 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 9246848f to d09dea64 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from e08039f9 to bba8419d 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 9246848f to d09dea64 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/7-nvfp4 branch from bba8419d to 4a79406c 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from d09dea64 to 83b72448 26 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 83b72448 to 51effe94 24 days ago
IlyasMoutawwakil Add Mxfp8Config: MXFP8 on the fine-grained machinery
3511ee66
IlyasMoutawwakil Document MXFP8, MiniMax-M3's public checkpoints and the formats compr…
8e2afa28
IlyasMoutawwakil Patch the finish helpers where the quantizer imports them
e08eb979
IlyasMoutawwakil Align the overview table row
a46e96bd
IlyasMoutawwakil Point the MiniMax-M3-VL speed example at the bf16 repo
dcdb6351
IlyasMoutawwakil Build the MiniMax-M3-VL parallel fixture from its model tester
806fbc6b
IlyasMoutawwakil Write the comments and docstrings in short plain sentences
ae606dc2
IlyasMoutawwakil Drop W8A4 from the MXFP8 docs and mixed-scheme grid, and document its…
1d10679d
IlyasMoutawwakil Pin MiniMax-M3-VL's routing in the parallel fixture and restore its d…
cabe18c9
IlyasMoutawwakil Explain why the FP8 quantizer import stays at the top of auto.py
a714ffb6
IlyasMoutawwakil Give the table test a model that holds the table
c4985f46
IlyasMoutawwakil Read MiniMax's ignored_layers through an mxfp8 reader
be47b9fc
IlyasMoutawwakil Leave MXFP8's ModelOpt and compressed-tensors layouts to the producer…
25ce4e30
IlyasMoutawwakil Restack on the simpler plan resolution and merging
42b862c5
IlyasMoutawwakil IlyasMoutawwakil force pushed from 51effe94 to 42b862c5 24 days ago
IlyasMoutawwakil Merge remote-tracking branch 'origin/fg-split/7-nvfp4' into fg-split/…
ba335359
github-actions

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone