PR #39 Group tensorboard metrics

Group tensorboard metrics #39

VictorSanh merged 12 commits into main from tensorboard

Training groupings

bbafd50a

validation grouping

c68cad42

steps vs samples

0447b630

iteration time (speed -> samples or iterations per second)

f14e7728

tensorboard group time (from `log_timers_to_tensorboard`)

cfb02c7a

comment on the writing condition

97101125

stas00 approved these changes on 2021-08-04

Update megatron/global_vars.py

f828e79c

Update megatron/training.py

dda74585

Update megatron/training.py

73b7c61d

Update megatron/training.py

c56c704a

Update megatron/training.py

1dcf28ad

link bug fix issue on megatron-lm side

7a43335c

VictorSanh merged 9e75429d into main 4 years ago

Reviewers

stas00

Assignees

No one assigned

Labels

None yet

Milestone

No milestone