DeepSpeed
Fix ZeRO-3 optimizer initialization validation (#7844)
#7929
Open

Fix ZeRO-3 optimizer initialization validation (#7844) #7929

amadhan882 wants to merge 8 commits into deepspeedai:master from amadhan882:master
amadhan882
amadhan882 amadhan882 requested a review from tjruwase tjruwase 9 days ago
amadhan882 amadhan882 requested a review from tohtana tohtana 9 days ago
amadhan882 amadhan882 force pushed from be85cec7 to 69f56635 9 days ago
amadhan882 amadhan882 force pushed from 6339f8c6 to c7417b90 9 days ago
amadhan882 Fix: Add ZeRO-3 optimizer validation and prevent AttributeError in ba…
a39180e4
amadhan882 amadhan882 force pushed from c7417b90 to a39180e4 9 days ago
sfc-gh-truwase Merge branch 'master' into master
d931be04
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-28
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-28
amadhan882 Refactor: Generalize ZeROOptimizer support and extend core APIs for B…
ddca910d
amadhan882 amadhan882 force pushed from 13af8352 to ddca910d 9 days ago
amadhan882 Fix: Add optimizer initialization validation and callable checks
b36d39a5
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-30
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-30
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-30
amadhan882 Fix: Add optimizer initialization validation for backward and ZeRO-3
b2e17ab1
amadhan882 amadhan882 force pushed from 7a662916 to b2e17ab1 6 days ago
amadhan882
amadhan882 amadhan882 requested a review from sfc-gh-truwase sfc-gh-truwase 6 days ago
sfc-gh-truwase
sfc-gh-truwase approved these changes on 2026-03-31
amadhan882 amadhan882 force pushed from 1741444a to b2e17ab1 6 days ago
amadhan882 Fix: Add ZeRO-3 specific optimizer validation and fix formatting
0711f9bb
amadhan882 Merge branch 'master' into master
d7496797
sfc-gh-truwase Merge branch 'master' into master
b1a3bc10
sfc-gh-truwase
amadhan882

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone