accelerate
23b09250
- [FSDP2] Fix memory spike with `cpu_ram_efficient_loading=True` (#3482)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
287 days ago
[FSDP2] Fix memory spike with `cpu_ram_efficient_loading=True` (#3482) * Feat: shard on meta device * Feat: support fqns in get_non_persistent_buffers * Fix: retie weights after loading
References
#3482 - [FSDP2] Fix memory spike with `cpu_ram_efficient_loading=True`
Author
S1ro1
Parents
8fb07353
Loading