pytorch

90bf6e39 - [FSDP][optim_state_dict] Enable cpu_offload config for optimzer state_dict (#108434)

[FSDP][optim_state_dict] Enable cpu_offload config for optimzer state_dict (#108434) We had the option but never used cpu_offload as optimizer state_dict offloads the tensors to CPU by default. And this is usually most users want as the tensors are required to be moved to CPU eventually. However, we may want to disable offloading to CPU in some cases, epsecially for the debugging purpose. This PR lets optimizer state_dict read the flag. Differential Revision: [D48913340](https://our.internmc.facebook.com/intern/diff/D48913340/) Pull Request resolved: https://github.com/pytorch/pytorch/pull/108434 Approved by: https://github.com/wz337