Megatron-DeepSpeed

afb1a4c8 - Log timers fix (#59)

Log timers fix (#59) * iteration time (speed -> samples or iterations per second) * make log timers work w/ multi-gpu Co-authored-by: Victor SANH <victorsanh@gmail.com>