DeepSpeed
async tp allreduce
#7115
Merged
Overview
Commits
14
Changes
View On GitHub

async tp allreduce #7115

loadams merged 14 commits into deepspeedai:master from inkcherry:async_tp
inkcherry
inkcherry inkcherry requested a review from hwchen2017 hwchen2017 1 year ago
inkcherry inkcherry requested a review from loadams loadams 1 year ago
hwchen2017
hwchen2017 commented on 2025-03-07
hwchen2017
hwchen2017 commented on 2025-03-07
inkcherry inkcherry requested a review from tjruwase tjruwase 1 year ago
inkcherry inkcherry requested a review from tohtana tohtana 1 year ago
inkcherry inkcherry force pushed from 4f779d5e to 9821852f 1 year ago
inkcherry
inkcherry inkcherry force pushed from 9821852f to 5d297e4c 1 year ago
inkcherry async tp
1b267b6b
loadams Update CONTRIBUTING.md to reflect changes from CLA to DCO (#7135)
f8ef8a74
tjruwase Avoid missing attr error (#7133)
3346e8c3
A-transformer Add conditional expression (#7119)
51338133
loadams Unpin transformers version for most workflows (#7139)
e867ae3c
inkcherry lower precision setting
d7f944e5
inkcherry inkcherry force pushed from 04432788 to d7f944e5 1 year ago
inkcherry Merge branch 'master' into async_tp
40eacfd3
delock Merge branch 'master' into async_tp
3914f483
inkcherry
loadams Merge branch 'master' into async_tp
d5247b99
hwchen2017 Merge branch 'master' into async_tp
9dde2963
tjruwase Merge branch 'master' into async_tp
3a372c2b
hwchen2017
hwchen2017 commented on 2025-03-21
hwchen2017 Merge branch 'master' into async_tp
fc0485f1
inkcherry rename overlap_comm to tp_overlap_comm
2d4b03d1
hwchen2017 Merge branch 'master' into async_tp
9500d554
hwchen2017
hwchen2017 approved these changes on 2025-03-28
loadams loadams merged b8cc1eb0 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum