DeepSpeed
8e91537e - Reset KV-cache at the beginning of text-generation

Commit

3 years ago

Reset KV-cache at the beginning of text-generation

References

#2709 - Fix softmax backward

#2916 - Codegen Inference Support

Author

Reza Yazdani

Parents

Loading