transformers
Move torch.compile() wrapping after DDP/FSDP wrapping to ensure correct graph breaks during training
#22279

Merged

Move torch.compile() wrapping after DDP/FSDP wrapping to ensure correct graph breaks during training #22279

sgugger merged 1 commit into huggingface:main from ani300:compile-compat-with-fsdp

Move torch.compile() wrapping after DDP/FSDP wrapping to ensure corre…

8c3d1e09

sgugger approved these changes on 2023-03-20

sgugger merged fb0a38b4 into main 3 years ago

ani300 deleted the compile-compat-with-fsdp branch 3 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone