Enhance testing: Skip fused_optimizer tests if not supported. (#5159)
Enhance testing: Skip fused_optimizer tests if not supported.
Added condition check to skip fused_optimizer tests if FusedAdam and
FusedLamb are not supported by the accelerator. This enhancement ensures
that the tests are appropriately skipped when the hardware configuration
does not support these optimizers, preventing potential issues.
Details:
- Introduced a condition check to determine support for FusedAdam and
FusedLamb.
- If not supported, fused_optimizer tests are skipped to improve test
reliability.
- Improved compatibility and stability across different hardware
configurations.
---------
Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>