transformers
Fix excessive CPU memory usage with FSDP and cpu_ram_efficient_loading
#33154

Merged

Fix excessive CPU memory usage with FSDP and cpu_ram_efficient_loading #33154

ArthurZucker merged 1 commit into main from restore-fsdp-meta-sharding

Fix excessive CPU memory usage with FSDP and cpu_ram_efficient_loading

1b07bd3a

matthewdouglas added PyTorch FSDP

matthewdouglas requested a review from

ArthurZucker 1 year ago

ArthurZucker commented on 2024-09-04

ArthurZucker approved these changes on 2024-09-04

ArthurZucker merged b3909989 into main 1 year ago

ArthurZucker deleted the restore-fsdp-meta-sharding branch 1 year ago

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

PyTorch FSDP

Milestone

No milestone