accelerate
Models With Tied Weights Need Re-Tieing After FSDP Param Init
#3154
Merged
Overview
Commits
3
Changes
View On GitHub

Models With Tied Weights Need Re-Tieing After FSDP Param Init #3154

muellerzr merged 3 commits into huggingface:main from fabianlim:fix/quant-lowcpumem
fabianlim
fabianlim add fsdp_tool to retie after param init
5c53a83f
fabianlim fabianlim changed the title Models With Tied Weights Need Re-Tieing After Models With Tied Weights Need Re-Tieing After FSDP Param Init 1 year ago
fabianlim make it handle generic param_init_fn
50b71274
muellerzr
muellerzr commented on 2024-10-11
muellerzr
muellerzr approved these changes on 2024-10-31
fabianlim fix quality
886ba0ef
fabianlim
HuggingFaceDocBuilderDev
muellerzr muellerzr merged 8159c98d into main 1 year ago
fabianlim
enesmsahin
fabianlim

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum