xla
[Backport] Add reduce-scatter coalescing for FSDP/ZeRO1 (#5956)
#6055
Merged
Overview
Commits
1
Changes
View On GitHub

[Backport] Add reduce-scatter coalescing for FSDP/ZeRO1 (#5956) #6055

ManfeiBai merged 1 commit into r2.2 from JackCaoG/backport_22_reduce_scatter
JackCaoG
jeffhataws Add reduce-scatter coalescing for FSDP/ZeRO1 (#5956)
4133ec26
JackCaoG JackCaoG requested a review from hjm-aws hjm-aws 2 years ago
JackCaoG JackCaoG requested a review from ManfeiBai ManfeiBai 2 years ago
ManfeiBai
ManfeiBai approved these changes on 2023-12-08
ManfeiBai ManfeiBai merged 8472abdf into r2.2 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum