accelerate
Models With Tied Weights Need Re-Tieing After FSDP Param Init
#3154
Merged

Commits
  • add fsdp_tool to retie after param init
    fabianlim committed 1 year ago
  • make it handle generic param_init_fn
    fabianlim committed 1 year ago
  • fix quality
    fabianlim committed 1 year ago
Loading