Megatron-DeepSpeed
add layernorm in Embedding
#191
Merged

add layernorm in Embedding #191

stas00 merged 3 commits into main from embed-layer-norm
stas00
stas00 add layernorm in Embedding
ddd4dff7
stas00 fix
f5c6c523
stas00 fix
82925d95
stas00 stas00 merged b1359ee0 into main 4 years ago
stas00 stas00 deleted the embed-layer-norm branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone