xla
Backport ZeRO1: Add bucketting logic to control the size of tensors for all-gather/reduce-scatter (#6025)
#6806
Merged
Overview
Commits
1
Changes
View On GitHub

Backport ZeRO1: Add bucketting logic to control the size of tensors for all-gather/reduce-scatter (#6025) #6806

lsy323 merged 1 commit into r2.3 from JackCaoG/backport_aws_zero1
JackCaoG
jeffhataws ZeRO1: Add bucketting logic to control the size of tensors for all-ga…
f28946f9
JackCaoG JackCaoG requested a review from lsy323 lsy323 1 year ago
JackCaoG
lsy323
lsy323 approved these changes on 2024-03-25
lsy323 lsy323 merged a805505d into r2.3 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum