xla
18c13e8f - Add tensor's barrier at the DataParallel iterator level, to make sure that even during validation (which is missing the optimizer step call), tensor's are synced.

Commit

6 years ago

Add tensor's barrier at the DataParallel iterator level, to make sure that even during validation (which is missing the optimizer step call), tensor's are synced.

References

validation_step

#858 - Sync tensors at DataParallel iterator level

Author

dlibenzi

Committer

dlibenzi

Parents

0fbb2518

xla 18c13e8f - Add tensor's barrier at the DataParallel iterator level, to make sure that even during validation (which is missing the optimizer step call), tensor's are synced.

xla
18c13e8f - Add tensor's barrier at the DataParallel iterator level, to make sure that even during validation (which is missing the optimizer step call), tensor's are synced.