DeepSpeed
Remove PP Grad Tail Check
#2538
Merged

Remove PP Grad Tail Check #2538

loadams merged 14 commits into deepspeedai:master from Quentin-Anthony:pp_fix
Quentin-Anthony
Quentin-Anthony Only communicate grad tail if it exists
54b55739
Quentin-Anthony Revert previous patch and just always send the grad tail
f3a28da0
Quentin-Anthony Quentin-Anthony requested a review from ShadenSmith ShadenSmith 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from duli2012 duli2012 3 years ago
Quentin-Anthony Merge branch 'master' into pp_fix
fb37e876
Quentin-Anthony Formatting
bdf805e5
tjruwase Merge branch 'master' into pp_fix
50c32f0b
Quentin-Anthony Merge branch 'master' into pp_fix
b27840ec
tjruwase Merge branch 'master' into pp_fix
72bb819a
Quentin-Anthony Merge branch 'master' into pp_fix
a9428d92
Quentin-Anthony Merge branch 'master' into pp_fix
d170c472
Quentin-Anthony Merge branch 'master' into pp_fix
297cbad4
Quentin-Anthony Merge branch 'master' into pp_fix
fe13d2f8
ShadenSmith
ShadenSmith commented on 2023-03-22
loadams Merge branch 'master' into pp_fix
b54cd03f
loadams loadams assigned loadams loadams 2 years ago
loadams
loadams Merge branch 'master' into pp_fix
85cfe766
Quentin-Anthony
loadams
loadams loadams requested a review from ShadenSmith ShadenSmith 2 years ago
loadams loadams requested a review from StellaAthena StellaAthena 2 years ago
RUAN-ZX
tjruwase Merge branch 'master' into pp_fix
c8558030
tjruwase
tjruwase approved these changes on 2023-10-26
loadams loadams enabled auto-merge 2 years ago
loadams loadams merged 3589cad8 into master 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
Labels
Milestone