xla
89574d2d
- Fix FSDP for Models with Frozen Weights (#5484) (#5539)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Fix FSDP for Models with Frozen Weights (#5484) (#5539) * Fix fsdp not freeing forzen full params * add test * formatting * remove unnecessary env var in test Co-authored-by: Liyang90 <liyanglu@google.com>
References
#7252 - [ZeRO-1] Only warn on rank-0
#5539 - Fix FSDP for Models with Frozen Weights
Author
wonjoo-wj
Parents
a1d3651f
Loading