xla
Reenable ZeRO1 test for GPU to enable coverage for reduce-scatter/all-gather
#6278

Merged

Reenable ZeRO1 test for GPU to enable coverage for reduce-scatter/all-gather #6278

ManfeiBai merged 2 commits into r2.2 from jeffhataws_r2.2_zero1_gpu

Set all_reduce_token to None when exiting (#6247)

8ae83a66

test_zero1 passes on GPU with latest torch/xla (commit e1c94df) (#6268)

2c63b724

jeffhataws added backport_2.2

alanwaketan approved these changes on 2024-01-09

alanwaketan requested a review from

JackCaoG 2 years ago

alanwaketan requested a review from

ManfeiBai 2 years ago

alanwaketan requested a review from

zpcore 2 years ago

ManfeiBai approved these changes on 2024-01-10

ManfeiBai merged a9637349 into r2.2 2 years ago

jeffhataws deleted the jeffhataws_r2.2_zero1_gpu branch 2 years ago

Reviewers

ManfeiBai

alanwaketan

JackCaoG

zpcore

Assignees

No one assigned

Labels

backport_2.2

Milestone

No milestone