DeepSpeed
BF16 optimizer: Improve device utilization by immediate grad update
#4975
Merged
Merged