DeepSpeed
09393275 - Add nightly full-suite run with classified failure triage and git-bisect

Commit
10 days ago
Add nightly full-suite run with classified failure triage and git-bisect The master full suite has grown ~33% in a month (52 -> 70 min) and is exhausting its time budgets. Instead of every push paying that cost: - push to master now selects tests against the tip it replaced (github.event.before); the nightly schedule always runs the full suite - the controller classifies its own failures as infra (no GPU instance), timeout (Sandbox lifetime exhausted), or test, via a DS_CI_FAILURE_CLASS log sentinel plus exit codes 75/124/1 - nightly-bisect.yml routes on that class: green moves the nightly-last-green tag, infra is a no-op, timeout opens an issue, and real failures git-bisect between nightly-last-green and the bad SHA by dispatching modal-torch-latest at each step, then report the culprit in an issue; inconclusive steps abort rather than skip so the searched range is never silently narrowed Also refresh stale self-tests that no longer matched master (sandbox timeout 4200->5400, merge-group trusted ref, baked-image fake, removed 'reinstall Torch packages' runtime command). Signed-off-by: Ma, Guokai <guokai.ma@intel.com>
Author
Parents
Loading