DeepSpeed
9f41ffe4
- Reset KV-cache at the beginning of text-generation (#2669)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Reset KV-cache at the beginning of text-generation (#2669) Co-authored-by: Martin Cai <martincai@users.noreply.github.com> Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
References
#2669 - Reset KV-cache at the beginning of text-generation
Author
RezaYazdaniAminabadi
Parents
4079077c
Loading