transformers
NVFP4 on the fine-grained machinery
#49779
Open

NVFP4 on the fine-grained machinery #49779

IlyasMoutawwakil wants to merge 19 commits into fg-split/6-mxfp4 from fg-split/7-nvfp4
IlyasMoutawwakil
IlyasMoutawwakil IlyasMoutawwakil force pushed from 3afadf9a to 4050b0b2 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 0e0531aa to ae62b387 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from ae62b387 to 5b3c9106 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 4050b0b2 to 1986d878 30 days ago
HuggingFaceDocBuilderDev
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 5b3c9106 to f41b6f51 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 1986d878 to 0967ed42 30 days ago
IlyasMoutawwakil IlyasMoutawwakil changed the title NVFP4 on the fine-grained machinery, with the producers' NVFP4 exports NVFP4 on the fine-grained machinery 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from f41b6f51 to d0129d79 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 0967ed42 to 0af5e23b 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from d0129d79 to b1979e6c 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 0af5e23b to 33ba73d6 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from b1979e6c to 4991a3bb 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 33ba73d6 to d89fabc6 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 4991a3bb to b6b30744 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from d89fabc6 to 95d3b51f 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from b6b30744 to d1069758 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 95d3b51f to 45ed0926 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 45ed0926 to d130d741 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 3837fcac to a1dd17d2 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from d130d741 to fb471e13 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from a1dd17d2 to 7183af2b 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from fb471e13 to 40cc59ce 30 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 7183af2b to 75e78c65 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 40cc59ce to bfd68ff6 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 75e78c65 to c81614cc 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from bfd68ff6 to 165fd890 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from c81614cc to e4ac490c 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 165fd890 to c004333a 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from c004333a to ec9a4cc1 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from e4ac490c to 941661e2 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 941661e2 to b1939494 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from ec9a4cc1 to 69c56d49 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from b1939494 to c3d0d8b2 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 69c56d49 to 5826dbfd 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from c3d0d8b2 to 15ee3366 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 5826dbfd to cf0866b5 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 15ee3366 to 9c003afe 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from cf0866b5 to 828290bf 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 828290bf to b2cce819 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 9c003afe to f8f9371e 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from f8f9371e to d9efb5bb 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from b2cce819 to 398f4ada 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 398f4ada to e08039f9 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from d9efb5bb to 0eb9021a 29 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from e08039f9 to bba8419d 28 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 0eb9021a to 1aafb732 28 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from e08039f9 to bba8419d 28 days ago
IlyasMoutawwakil IlyasMoutawwakil force-pushed the fg-split/6-mxfp4 branch from 1aafb732 to ba15098d 28 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from bba8419d to 4a79406c 28 days ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 4a79406c to a7ac103f 27 days ago
IlyasMoutawwakil Move NVFP4Config onto the fine-grained machinery, with the producers'…
fb79484a
IlyasMoutawwakil Document NVFP4 on the fine-grained machinery and ModelOpt mixed-preci…
43ddf8d7
IlyasMoutawwakil Delete the frozen NVFP4 integration
d83fbbf2
IlyasMoutawwakil Lend NVFP4's activation format like its other loading attributes
164c37e5
IlyasMoutawwakil Give the DeepGEMM refusal test's experts two K bands so MX scales swi…
d1b7081c
IlyasMoutawwakil Skip the NVFP4 activation check when a plan load dequantizes
1f728460
IlyasMoutawwakil Explain why NVFP4 inverts its globals and checks weight-only loads
4477b933
IlyasMoutawwakil Test that DeepGEMM grouped experts refuse the Triton layout
1b7d4f44
IlyasMoutawwakil Update the NVFP4 plan tests for the generic host
e7f30fc2
IlyasMoutawwakil Fix the plan tests the host rebase merged twice
b6defe6c
IlyasMoutawwakil Read the NVFP4 producer layouts through get_weight_conversions
cb8ecaf3
IlyasMoutawwakil Name the embedding tables of the NVFP4 tests with targeted plan entries
f62e0ec7
IlyasMoutawwakil Keep the old NVFP4 integration importable for a deprecation cycle
7bfee090
IlyasMoutawwakil Let a post-expert norm declare its fused kernel form
883435d2
IlyasMoutawwakil Give the table test a model that holds the table
1a1bfd5a
IlyasMoutawwakil Leave NVFP4's compressed-tensors and ModelOpt export support to the p…
bc73e938
IlyasMoutawwakil Keep the saved-FP8 DeepSeek-V4 check in the plan test that stays
16910d45
IlyasMoutawwakil Restack on the simpler plan resolution and merging
9ee98c88
IlyasMoutawwakil IlyasMoutawwakil force pushed from a7ac103f to 9ee98c88 27 days ago
IlyasMoutawwakil Merge remote-tracking branch 'origin/fg-split/6-mxfp4' into fg-split/…
5e59d756
github-actions

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone