transformers
fix(distributed): bind TPU ranks to device index 0, not LOCAL_RANK
#49543

Merged

fix(distributed): bind TPU ranks to device index 0, not LOCAL_RANK #49543

tengomucho merged 5 commits into main from tpu-dist-issue

fix(distributed): bind TPU ranks to device index 0, not LOCAL_RANK

8f32d365

tengomucho requested a review from

3outeille 12 days ago

3outeille commented on 2026-10-13

3outeille requested a review from

ArthurZucker 12 days ago

refactor(distributed): factor device binding into _bind_local_device

50ce0159

fix(distributed): default LOCAL_RANK to 0 in initialize_tensor_parall…

28f3d2cc

Merge remote-tracking branch 'origin/main' into tpu-dist-issue

d4594a09

3outeille commented on 2026-10-13

refactor(distributed): inline TPU device index into _bind_local_device

b0e0a294

tengomucho requested a review from

3outeille 11 days ago

ArthurZucker approved these changes on 2026-10-14

tengomucho merged 5602e09e into main 11 days ago

tengomucho deleted the tpu-dist-issue branch 11 days ago

Reviewers

ArthurZucker

3outeille

Assignees

No one assigned

Labels

None yet

Milestone

No milestone