DeepSpeed
e2dfcadf
- Fix the bias-add and add the layer-norm-eps parameter (#791)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Fix the bias-add and add the layer-norm-eps parameter (#791) * fix the bias-add precision and indexing and also adding the layer-norm-eps as a configurable parameter for transformer * add ACC_HALF config * use defined to check if ACC_Half is defined
References
#791 - Fix the bias-add and add the layer-norm-eps parameter
Author
RezaYazdaniAminabadi
Parents
48065c06
Loading