xla
2b16a718
- [FSDP] Don't use detach in _rebuild_full_params (#4813)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
[FSDP] Don't use detach in _rebuild_full_params (#4813) Summary: Somehow the detach_copy implementation has some issues with FSDP that it messed up with FSDP's memory management mechanism. Let's not use it. Test Plan: CI
References
#4813 - [FSDP] Don't use detach in _rebuild_full_params
Author
alanwaketan
Parents
46e62380
Loading