text-generation-inference
8c437a80
- add kvcache fp8 support
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
add kvcache fp8 support
Author
mohit@huggingface.co
Parents
efb73fcb
Loading