DeepSpeed
Reset KV-cache at the beginning of text-generation
#2669
Merged

Commits
  • Reset KV-cache at the beginning of text-generation
    Reza Yazdani committed 3 years ago
  • Merge branch 'master' into kv-cache-reset
    RezaYazdaniAminabadi committed 3 years ago
  • Merge branch 'master' into kv-cache-reset
    RezaYazdaniAminabadi committed 3 years ago
  • Merge branch 'master' into kv-cache-reset
    RezaYazdaniAminabadi committed 3 years ago
  • reset cache only if using inferece_cuda module
    Reza Yazdani committed 3 years ago
  • Merge branch 'kv-cache-reset' of github.com:microsoft/DeepSpeed into kv-cache-reset
    Reza Yazdani committed 3 years ago
  • Merge branch 'master' into kv-cache-reset
    martincai committed 3 years ago
  • formatting
    jeffra committed 3 years ago
Loading