PR #46957 Finegrained FP8 v4: fused grouepd/batched

Finegrained FP8 v4: fused grouepd/batched #46957

IlyasMoutawwakil wants to merge 8 commits into main from finegrained-fp8-v4

43ce4632

rename

0314297a

IlyasMoutawwakil requested a review from

ArthurZucker 114 days ago

IlyasMoutawwakil requested a review from

vasqu 114 days ago

IlyasMoutawwakil removed review request from

vasqu 114 days ago

IlyasMoutawwakil requested a review from

copilot-pull-request-reviewer 114 days ago

IlyasMoutawwakil requested a review from

vasqu 114 days ago

IlyasMoutawwakil marked this pull request as ready for review 114 days ago

copilot-pull-request-reviewer commented on 2026-06-29

vasqu approved these changes on 2026-06-29

ArthurZucker approved these changes on 2026-07-01

support swiglu stuff

821acbe0

Merge branch 'main' into finegrained-fp8-v4

08a6ed92

scale fmt with mxfp8

a26c2dbd

honor the dtype

555123f3

fix vision tower quantization

3b806cac

avoid cache to avoid dynamo thrashing warnings

60094843

IlyasMoutawwakil requested a review from

vasqu 111 days ago

IlyasMoutawwakil requested a review from

ArthurZucker 111 days ago

vasqu approved these changes on 2026-07-02

vasqu marked this pull request as draft 4 hours ago

Reviewers

vasqu

ArthurZucker

copilot-pull-request-reviewer

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Finegrained FP8 v4: fused grouepd/batched #46957 Open

Finegrained FP8 v4: fused grouepd/batched #46957

transformers
Finegrained FP8 v4: fused grouepd/batched
#46957

Open