DeepSpeed
be507383
- Add unidirectional attention options to BigBird and BSLongformer
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 years ago
Add unidirectional attention options to BigBird and BSLongformer
References
#1959 - Add Unidirectional Sparse Attention Type to BigBird and BSLongformer
Author
Quentin-Anthony
Parents
09f1ad5e
Loading