transformers
cfe81b4a
- FineGrainedFP8Config(experts_only=True): keep only the MoE experts in FP8
Go
Login via GitHub
Home
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 hours ago
FineGrainedFP8Config(experts_only=True): keep only the MoE experts in FP8
References
#51089 - Fine-grained FP8: keep only the MoE experts in FP8 with `experts_only=True`
Author
qgallouedec
Parents
2f1bc5e3
Loading