DeepSpeed
Fix ZeRO-3 optimizer initialization validation (#7844)
#7929
Open

Fix ZeRO-3 optimizer initialization validation (#7844) #7929

amadhan882 wants to merge 8 commits into deepspeedai:master from amadhan882:master
amadhan882
amadhan882 amadhan882 requested a review from tjruwase tjruwase 13 days ago
amadhan882 amadhan882 requested a review from tohtana tohtana 13 days ago
amadhan882 amadhan882 force pushed from be85cec7 to 69f56635 13 days ago
amadhan882 amadhan882 force pushed from 6339f8c6 to c7417b90 13 days ago
amadhan882 Fix: Add ZeRO-3 optimizer validation and prevent AttributeError in ba…
a39180e4
amadhan882 amadhan882 force pushed from c7417b90 to a39180e4 13 days ago
sfc-gh-truwase Merge branch 'master' into master
d931be04
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-28
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-28
amadhan882 Refactor: Generalize ZeROOptimizer support and extend core APIs for B…
ddca910d
amadhan882 amadhan882 force pushed from 13af8352 to ddca910d 13 days ago
amadhan882 Fix: Add optimizer initialization validation and callable checks
b36d39a5
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-30
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-30
sfc-gh-truwase
sfc-gh-truwase commented on 2026-03-30
amadhan882 Fix: Add optimizer initialization validation for backward and ZeRO-3
b2e17ab1
amadhan882 amadhan882 force pushed from 7a662916 to b2e17ab1 10 days ago
amadhan882
amadhan882 amadhan882 requested a review from sfc-gh-truwase sfc-gh-truwase 10 days ago
sfc-gh-truwase
sfc-gh-truwase approved these changes on 2026-03-31
amadhan882 amadhan882 force pushed from 1741444a to b2e17ab1 10 days ago
amadhan882 Fix: Add ZeRO-3 specific optimizer validation and fix formatting
0711f9bb
amadhan882 Merge branch 'master' into master
d7496797
sfc-gh-truwase Merge branch 'master' into master
b1a3bc10
sfc-gh-truwase
amadhan882

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone