PR #43512 Enable mxfp4 model on CPU

Enable mxfp4 model on CPU #43512

MekkCyber merged 16 commits into huggingface:main from jiqing-feng:mxfp4

enable mxfp4 on CPU

032ed49e

test mxfp4

b2753541

revert error change

e31485c0

Rocketknight1 closed this 142 days ago

Rocketknight1 reopened this 142 days ago

jiqing-feng force pushed from 120bb3b1 to e31485c0 141 days ago

fix mxfp4 device check

1761336d

fix mxfp4 check

aad97d66

update tests

d1582c7f

add cpu dispatch

01970054

update mxfp4 kernel check

ca415adb

Merge branch 'main' into mxfp4

15b8ef96

Merge branch 'main' into mxfp4

944cab67

Merge branch 'main' into mxfp4

76de5572

jiqing-feng force pushed from d672d096 to 76de5572 132 days ago

dequantize mxfp4 model if don't use kernels on CPU

143a5ecf

Merge branch 'main' into mxfp4

594923b8

jiqing-feng marked this pull request as ready for review 129 days ago

github-actions requested a review from

MekkCyber 129 days ago

github-actions requested a review from

SunMarc 129 days ago

MekkCyber commented on 2026-02-09

rm comments

63c01f1f

Merge branch 'main' into mxfp4

deba87a3

SunMarc requested a review from

MekkCyber 121 days ago

Merge branch 'main' into mxfp4

3c8a71a9

MekkCyber approved these changes on 2026-02-24

MekkCyber merged 69fd225a into main 114 days ago

jiqing-feng deleted the mxfp4 branch 59 days ago

Reviewers

MekkCyber

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Enable mxfp4 model on CPU #43512 Merged

Enable mxfp4 model on CPU #43512

transformers
Enable mxfp4 model on CPU
#43512

Merged