[SPMD] Add defunctionalize_optimizer feature (#96323)
Summary: The manually adding dependencies between _foreach_add_, _fused_adam_, and output can cause issues when lowering to Inductor. This API removes those dependencies.
Test Plan: CI
Differential Revision: D43916450
Pull Request resolved: https://github.com/pytorch/pytorch/pull/96323
Approved by: https://github.com/kumpera