DeepSpeed
sequence parallel default dtype
#7364
Merged

sequence parallel default dtype #7364

stas00 merged 8 commits into master from stas/nccl-fp32-accum
stas00
stas00 sequence parallel default dtype
5d101f9c
stas00 stas00 requested a review from tjruwase tjruwase 101 days ago
stas00 stas00 requested a review from tohtana tohtana 101 days ago
tjruwase
tjruwase approved these changes on 2025-06-17
stas00 Merge branch 'master' into stas/nccl-fp32-accum
4707b42a
tjruwase Merge branch 'master' into stas/nccl-fp32-accum
12dbc2a6
tjruwase Merge branch 'master' into stas/nccl-fp32-accum
2757f292
stas00
stas00 use newer image/pytorch version
ae70d39a
stas00 Merge remote-tracking branch 'origin/master' into stas/nccl-fp32-accum
9afc75bf
stas00 Merge branch 'stas/nccl-fp32-accum' of https://github.com:/deepspeeda…
9416af5d
stas00 stas00 requested a review from loadams loadams 98 days ago
stas00 try another image
b3a797ca
stas00 stas00 enabled auto-merge (squash) 98 days ago
stas00 stas00 merged d3b9cb8c into master 98 days ago
stas00 stas00 deleted the stas/nccl-fp32-accum branch 98 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone