DeepSpeed

ba6bfd0b - fix mics run with offload++ (#4749)

fix mics run with offload++ (#4749) fix mics run error by making it compatible with zero-offload++ Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>