DeepSpeed
Stop tracking backward chain of broadcast (ZeRO3)
#5113

Merged

Commits

stop tracking backward chain of broadcast (z3)

Masahiro Tanaka committed 2 years ago

Loading