Megatron-DeepSpeed
allocate embed norm only on pp0
#261
Merged
Overview
Commits
3
Changes
View On GitHub

allocate embed norm only on pp0 #261

stas00 merged 3 commits into main from embed-norm-pp0-only
stas00
stas00 allocate embed norm only on pp0
9e5ffbab
stas00 text
caca39a8
stas00 Merge remote-tracking branch 'origin/main' into embed-norm-pp0-only
bbee453c
stas00 stas00 merged dd06ea32 into main 3 years ago
stas00 stas00 deleted the embed-norm-pp0-only branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum