PR #2928 Add fp8 support moe models

Add fp8 support moe models #2928

danieldk merged 2 commits into main from add_moe_fp8

Add fp8 support moe models

16162602

mht-sharma requested a review from

danieldk 1 year ago

mht-sharma requested a review from

Narsil 1 year ago

danieldk commented on 2025-01-24

flatten condition

7be2a5f3

mht-sharma requested a review from

danieldk 1 year ago

danieldk approved these changes on 2025-01-29

danieldk merged 4ef2e045 into main 1 year ago

danieldk deleted the add_moe_fp8 branch 1 year ago

Reviewers

danieldk

Narsil

Assignees

No one assigned

Labels

None yet

Milestone

No milestone