accelerate
[FSDP2] Fix memory spike with `cpu_ram_efficient_loading=True`
#3482

Merged

[FSDP2] Fix memory spike with `cpu_ram_efficient_loading=True` #3482

S1ro1 merged 3 commits into main from fsdp2-cpu-ram-efficient-loading

SunMarc commented on 2025-04-17

Feat: shard on meta device

b77704e9

Feat: support fqns in get_non_persistent_buffers

7f02b61c

S1ro1 force pushed from 63cd1530 to 7f02b61c 1 year ago

S1ro1 changed the title ~~Fsdp2 cpu ram efficient loading~~ [FSDP2] Fix memory spike with `cpu_ram_efficient_loading=True` 1 year ago

Fix: retie weights after loading

96360793

SunMarc commented on 2025-04-23

SunMarc approved these changes on 2025-04-23

S1ro1 merged 23b09250 into main 1 year ago

S1ro1 deleted the fsdp2-cpu-ram-efficient-loading branch 1 year ago

Reviewers

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone