DeepSpeed
[MiCS]Add the path to support sequence_data_parallel on MiCS
#4926
Merged

[MiCS]Add the path to support sequence_data_parallel on MiCS #4926

tjruwase merged 2 commits into deepspeedai:master from sup_seq_dp_for_mics
ys950902
ys950902 add support for sequence_data_parallel on MiCS
15736ed7
ys950902 ys950902 requested a review from tjruwase tjruwase 1 year ago
ys950902 ys950902 requested a review from mrwyattii mrwyattii 1 year ago
ys950902
tjruwase Merge branch 'master' into sup_seq_dp_for_mics
887cd05f
tjruwase tjruwase assigned samadejacobs samadejacobs 1 year ago
tjruwase tjruwase removed review request from mrwyattii mrwyattii 1 year ago
tjruwase tjruwase requested a review from samadejacobs samadejacobs 1 year ago
samadejacobs
samadejacobs approved these changes on 2024-01-17
samadejacobs samadejacobs requested a review from samadejacobs samadejacobs 1 year ago
samadejacobs
samadejacobs approved these changes on 2024-01-17
tjruwase tjruwase merged 752a50ac into master 1 year ago
ys950902 ys950902 deleted the sup_seq_dp_for_mics branch 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
Labels
Milestone