Megatron-DeepSpeed
7181de45
- Add a test that the packed_masking works in the modeling side
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Add a test that the packed_masking works in the modeling side
References
#295 - MTF train script
#300 - [MLM] Train script for non causal decoder
Author
thomasw21
Parents
a8fcd386
Loading