DeepSpeed
a33655cb - Fix DeepCompile profile metadata backfill (#8094)

Commit
15 days ago
Fix DeepCompile profile metadata backfill (#8094) DeepCompile ZeRO-3 scheduling can crash with KeyError or AssertionError on missing device_time when graph profiling fails partway and leaves some nodes without timing metadata. This PR backfills default timing and memory metadata after profiling cleanup so the profiler guarantees downstream passes see complete metadata on every node. --------- Signed-off-by: Masahiro Tanaka <mtanaka@anyscale.com>
Author
Parents
Loading