DeepSpeed

db4638d1 - Extend HE-Lora test with Z3 support + Fix/add guard in HE for Z3 (#3883)

Extend HE-Lora test with Z3 support + Fix/add guard in HE for Z3 (#3883) * extend the test and fix fp16 typo. * guard reset params with z3 enabled check. --------- Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>