DeepSpeed

fac1df99 - tensorboard logging: avoid item() outside gas to improve performance (#5135)

tensorboard logging: avoid item() outside gas to improve performance (#5135) item() causes device/host synchronization Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>