DeepSpeed
e7592ea5 - Guard unmanaged gradient accumulation against unsupported features

Commit
17 days ago
Guard unmanaged gradient accumulation against unsupported features Reject managed_gradient_accumulation=False with DeepCompile and Apex AMP, since both perform boundary-gated work during backward() that the unmanaged path (boundary only at step()) breaks. Move all unmanaged-mode guards into _do_sanity_check() and tersify related comments. Signed-off-by: Olatunji Ruwase <tunji.ruwase@snowflake.com> Co-authored-by: Cursor <cursoragent@cursor.com>
Parents
Loading