transformers
Default `synced_gpus` to `True` when using `FullyShardedDataParallel`
#33483
Merged
Merged
Default `synced_gpus` to `True` when using `FullyShardedDataParallel` #33483
muellerzr
merged
17 commits into
huggingface:main
from
ringohoffman:fsdp-generate-synced_gpus-default-to-true
Default synced_gpus to True when using FullyShardedDataParallel
7179e614
Remove test file
823a44b3
ruff formatting
80af5a04
ruff format
4cfee750
ringohoffman
changed the title
Merge branch 'main' into fsdp-generate-synced_gpus-default-to-true
24fecab4
ArthurZucker
approved these changes
on 2024-10-03
Update copyright year
b06d7a02
Merge branch 'main' into fsdp-generate-synced_gpus-default-to-true
ed1bb713
Add test for FSDP-wrapped model generation
5811565d
Ruff format
7183b247
Move argparse import
aadaddc2
Remove barrier
c0468c40
Move import into function to decrease load time
22680991
muellerzr
approved these changes
on 2024-10-07
Add test for accelerate and Trainer
fb1805de
Refactor imports
c0f2b5fb
Ruff format
7beca831
Use nullcontext
d81ca75b
Merge branch 'main' into fsdp-generate-synced_gpus-default-to-true
84cafb72
muellerzr
approved these changes
on 2024-10-10
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub