DeepSpeed
async tp allreduce
#7115
Merged
Overview
Commits
14
Changes
View On GitHub

async tp allreduce #7115

loadams merged 14 commits into deepspeedai:master from inkcherry:async_tp
inkcherry
inkcherry inkcherry requested a review from hwchen2017 hwchen2017 351 days ago
inkcherry inkcherry requested a review from loadams loadams 351 days ago
hwchen2017
hwchen2017 commented on 2025-03-07
hwchen2017
hwchen2017 commented on 2025-03-07
inkcherry inkcherry requested a review from tjruwase tjruwase 345 days ago
inkcherry inkcherry requested a review from tohtana tohtana 345 days ago
inkcherry inkcherry force pushed from 4f779d5e to 9821852f 345 days ago
inkcherry
inkcherry inkcherry force pushed from 9821852f to 5d297e4c 345 days ago
inkcherry async tp
1b267b6b
loadams Update CONTRIBUTING.md to reflect changes from CLA to DCO (#7135)
f8ef8a74
tjruwase Avoid missing attr error (#7133)
3346e8c3
A-transformer Add conditional expression (#7119)
51338133
loadams Unpin transformers version for most workflows (#7139)
e867ae3c
inkcherry lower precision setting
d7f944e5
inkcherry inkcherry force pushed from 04432788 to d7f944e5 341 days ago
inkcherry Merge branch 'master' into async_tp
40eacfd3
delock Merge branch 'master' into async_tp
3914f483
inkcherry
loadams Merge branch 'master' into async_tp
d5247b99
hwchen2017 Merge branch 'master' into async_tp
9dde2963
tjruwase Merge branch 'master' into async_tp
3a372c2b
hwchen2017
hwchen2017 commented on 2025-03-21
hwchen2017 Merge branch 'master' into async_tp
fc0485f1
inkcherry rename overlap_comm to tp_overlap_comm
2d4b03d1
hwchen2017 Merge branch 'master' into async_tp
9500d554
hwchen2017
hwchen2017 approved these changes on 2025-03-28
loadams loadams merged b8cc1eb0 into master 329 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum