Megatron-DeepSpeed
4ed19efb - [logging] synced print (#217)

Commit
4 years ago
[logging] synced print (#217) This PR is trying to fix interleaved prints, like: ``` [003-008] 103.3651B / 103.3651B [002-030] 103.3651B / 103.3651B[001-030] 103.3651B / 103.3651B [001-022] 103.3651B / 103.3651B [001-021] 103.3651B / 103.3651B [003-017] 103.3651B / 103.3651B [001-015] 103.3651B / 103.3651B[003-015] 103.3651B / 103.3651B[002-015] 103.3651B / 103.3651B ```
Author
Parents
Loading