Add torch._foreach_maximum(TensorList, TensorList) & torch._foreach_minimum(TensorList, TensorList) APIs (#45692)
Summary:
- Adding torch._foreach_maximum(TensorList, TensorList) API
- Adding torch._foreach_minimum(TensorList, TensorList) API
- Updated Adam/AdamW optimizers
Tested via unit tests
Pull Request resolved: https://github.com/pytorch/pytorch/pull/45692
Reviewed By: anjali411
Differential Revision: D24142464
Pulled By: izdeby
fbshipit-source-id: 6a4fc343a1613cb1e26c8398450ac9cea0a2eb51