accelerate
Fix FSDP2 tied-embedding models on torch >= 2.13: put the output embedding in the same fully_shard group
#4171

Merged

Fix FSDP2 tied-embedding models on torch >= 2.13: put the output embedding in the same fully_shard group #4171

SunMarc merged 1 commit into main from fix-fsdp2-tied-embeddings

Fix FSDP2 tied-embedding models on torch >= 2.13: put output embeddin…

dfeee356

SunMarc requested a review from

SunMarc 5 days ago

SunMarc approved these changes on 2026-08-20

SunMarc merged f8012607 into main 5 days ago

SunMarc deleted the fix-fsdp2-tied-embeddings branch 5 days ago

Reviewers

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone