DeepSpeed
pipe engine _aggregate_total_loss: more efficient loss concatenation
#4327
Merged

pipe engine _aggregate_total_loss: more efficient loss concatenation #4327

nelyahu
_aggregate_total_loss: more efficient loss concatenation
edd0b8ec
nelyahu nelyahu requested a review from ShadenSmith ShadenSmith 2 years ago
nelyahu nelyahu requested a review from duli2012 duli2012 2 years ago
tjruwase
tjruwase approved these changes on 2023-10-06
tjruwase Merge branch 'master' into _aggregate_total_loss
edf32ceb
nelyahu Merge branch 'microsoft:master' into _aggregate_total_loss
75e4ef04
Fixing the if/else block on which the optimization should take place
932ca43f
nelyahu
tjruwase Merge branch 'master' into _aggregate_total_loss
7d583380
nelyahu Merge branch 'microsoft:master' into _aggregate_total_loss
1ef033da
nelyahu
tjruwase tjruwase enabled auto-merge 2 years ago
tjruwase tjruwase merged a02de228 into master 2 years ago
nelyahu nelyahu deleted the _aggregate_total_loss branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone