DeepSpeed
a0bd66c6
- support higher sequence length in softmax backward (>2048 & <8192)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
support higher sequence length in softmax backward (>2048 & <8192)
References
transformer/large-seq-support
Author
Reza Yazdani
Parents
b1669c0d
Loading