DeepSpeed
fae0276f - Fix AutoEP ZeRO-2 expert gradient scaling

Commit

10 days ago

Fix AutoEP ZeRO-2 expert gradient scaling Signed-off-by: Masahiro Tanaka <mtanaka@anyscale.com>

Author

tohtana

Parents