Add fp8 support moe models #2928

danieldk merged 2 commits into main from add_moe_fp8
mht-sharma
mht-sharma Add fp8 support moe models
16162602
mht-sharma mht-sharma requested a review from danieldk danieldk 332 days ago
mht-sharma mht-sharma requested a review from Narsil Narsil 332 days ago
danieldk
danieldk commented on 2025-01-24
mht-sharma flatten condition
7be2a5f3
mht-sharma mht-sharma requested a review from danieldk danieldk 324 days ago
danieldk
danieldk approved these changes on 2025-01-29
danieldk danieldk merged 4ef2e045 into main 324 days ago
danieldk danieldk deleted the add_moe_fp8 branch 324 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone