DeepSpeed
2a4ee92b - Skip fp16 ZeroPP tests on accelerators without fp16 support (#8610)

Commit
6 days ago
Skip fp16 ZeroPP tests on accelerators without fp16 support (#8610) Follow up #8381 @delock **Fix zeropp 9 (sequential)** in https://github.com/deepspeedai/DeepSpeed/pull/8381#issuecomment-5706365637 ``` unit/runtime/zero/test_zeropp.py ``` <img width="624" height="349" alt="image" src="https://github.com/user-attachments/assets/85750e15-91ca-4290-ae90-734302f20324" /> **passed in https://github.com/deepspeedai/DeepSpeed/actions/runs/35571162595/job/106242965025** This pull request updates the `tests/unit/runtime/zero/test_zeropp.py` test suite to ensure that certain tests are only run on accelerators that support FP16 precision. This prevents test failures on hardware that does not support FP16. Test robustness improvements: * Added `@pytest.mark.skipif` decorators to the `test`, `test_eval`, and `test_gradient_accumulation` methods in `TestZeroPPConfigSweep` and a `test` method in another test class, so these tests are skipped if the accelerator does not support FP16. This uses `get_accelerator().is_fp16_supported()` to check hardware capability. [[1]](diffhunk://#diff-e3c08df84c5c79ec0d57c31a7817cddb1ba2f31c620c482eaf4561698ffc3f27R173) [[2]](diffhunk://#diff-e3c08df84c5c79ec0d57c31a7817cddb1ba2f31c620c482eaf4561698ffc3f27R216) [[3]](diffhunk://#diff-e3c08df84c5c79ec0d57c31a7817cddb1ba2f31c620c482eaf4561698ffc3f27R258) [[4]](diffhunk://#diff-e3c08df84c5c79ec0d57c31a7817cddb1ba2f31c620c482eaf4561698ffc3f27R384) * Imported `get_accelerator` from `deepspeed.accelerator` to enable the FP16 support check. --------- Signed-off-by: Jin, Youzhi <youzhi.jin@intel.com>
Author
Parents
Loading