DeepSpeed
8e91537e
- Reset KV-cache at the beginning of text-generation
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 years ago
Reset KV-cache at the beginning of text-generation
References
#2709 - Fix softmax backward
#2916 - Codegen Inference Support
Author
Reza Yazdani
Parents
a091bc22
Loading