transformers
Inclusion of process_group in the gather_full_tensor function in tensor_parallel.py
#43932

Merged

Inclusion of process_group in the gather_full_tensor function in tensor_parallel.py #43932

ArthurZucker merged 2 commits into huggingface:main from quic-meetkuma:bug_fix

Bug fix on gather_full_tensor for upstreaming.

b0229f1f

Made correct usage of process_group in all_gather now.

b48c5914

quic-meetkuma force pushed from 8dcf9a58 to b48c5914 150 days ago

quic-meetkuma marked this pull request as ready for review 150 days ago

quic-meetkuma changed the title ~~[WIP] Inclusion of process_group in the gather_full_tensor function in tensor_parallel.py~~ Inclusion of process_group in the gather_full_tensor function in tensor_parallel.py 150 days ago

github-actions requested a review from

MekkCyber 150 days ago

github-actions requested a review from

SunMarc 150 days ago

SunMarc requested a review from

3outeille 150 days ago

ArthurZucker approved these changes on 2026-02-13

ArthurZucker merged f73a4db3 into main 149 days ago

Reviewers

ArthurZucker

MekkCyber

SunMarc

3outeille

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Inclusion of process_group in the gather_full_tensor function in tensor_parallel.py #43932 Merged

Inclusion of process_group in the gather_full_tensor function in tensor_parallel.py #43932

transformers
Inclusion of process_group in the gather_full_tensor function in tensor_parallel.py
#43932

Merged