accelerate
FSDP2: don't upcast placeholder weights on non-main ranks with cpu_ram_efficient_loading
#4369
Merged
Overview
Commits
1
Changes
View On GitHub

FSDP2: don't upcast placeholder weights on non-main ranks with cpu_ram_efficient_loading #4369

SunMarc merged 1 commit into huggingface:main from pagel-s:fsdp2-efficient-loading-upcast
pagel-s
pagel-s FSDP2: move placeholder weights to meta before the fp32 upcast
aba73348
SunMarc
SunMarc approved these changes on 2026-10-06
HuggingFaceDocBuilderDev
pagel-s
SunMarc SunMarc merged 2f4c053a into main 19 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum