Megatron-DeepSpeed
[embed norm] switch to apex MixedFusedLayerNorm
#262
Merged
Overview
Commits
1
Changes
View On GitHub

[embed norm] switch to apex MixedFusedLayerNorm #262

stas00 merged 1 commit into main from embed-fused_layer_norm
stas00
stas00 switch to MixedFusedLayerNorm
784bf7f6
stas00 stas00 merged b9883f44 into main 3 years ago
stas00 stas00 deleted the embed-fused_layer_norm branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum