DeepSpeed
e2dfcadf - Fix the bias-add and add the layer-norm-eps parameter (#791)

Commit
4 years ago
Fix the bias-add and add the layer-norm-eps parameter (#791) * fix the bias-add precision and indexing and also adding the layer-norm-eps as a configurable parameter for transformer * add ACC_HALF config * use defined to check if ACC_Half is defined
Parents
Loading