DeepSpeed
bfe7f0db
- Fix cudaErrorInvalidConfiguration in attn_softmax() for large seq_length*heads values (#1239)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Fix cudaErrorInvalidConfiguration in attn_softmax() for large seq_length*heads values (#1239) Co-authored-by: Ivan Komarov <dfyz@yandex-team.ru> Co-authored-by: Reza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
References
#1239 - Fix cudaErrorInvalidConfiguration in attn_softmax() for large values of sequence_length*num_heads
Author
dfyz
Parents
4d420df5
Loading