PR #34373 enable average tokens across devices

enable average tokens across devices #34373

ArthurZucker merged 12 commits into huggingface:main from main

enable average tokens across devices

590a522e

muellerzr commented on 2024-10-24

reduce earlier in case model needs it

647203b6

muellerzr commented on 2024-10-24

simplify if statement

8fd583de

muellerzr approved these changes on 2024-10-24

muellerzr requested a review from

SunMarc 1 year ago

SunMarc approved these changes on 2024-10-24

reformat code to make ruff happy

190d5341

add doc for argument: average_tokens_across_devices

ae9fbe93

Merge branch 'main' into main

4c8d02fd

Merge branch 'main' into main

70919a13

techkang requested a review from

SunMarc 1 year ago

cannot find world size when pytorch is unavailable

8ca8c4d5

format code

1eab2091

techkang requested a review from

muellerzr 1 year ago

muellerzr approved these changes on 2024-10-25

muellerzr requested a review from

ArthurZucker 1 year ago

SunMarc commented on 2024-10-25

SunMarc approved these changes on 2024-10-25

Merge branch 'main' into main

cdbb3d38

Merge branch 'main' into main

bd8ae99b

ArthurZucker approved these changes on 2024-10-28

Merge branch 'main' into main

588a80ee

ArthurZucker merged d21dbd15 into main 1 year ago

Reviewers

ArthurZucker

SunMarc

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers enable average tokens across devices #34373 Merged

enable average tokens across devices #34373

transformers
enable average tokens across devices
#34373

Merged