text-generation-inference
4ef2e045
- Add fp8 support moe models (#2928)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
323 days ago
Add fp8 support moe models (#2928) * Add fp8 support moe models * flatten condition
References
#2928 - Add fp8 support moe models
Author
mht-sharma
Parents
73b7cf83
Loading