DeepSpeed
A zero-element parameter loses its shape when it is bound to a flat buffer
#8467
Open

A zero-element parameter loses its shape when it is bound to a flat buffer #8467

alanhuangyoo
alanhuangyoo alanhuangyoo requested a review from tjruwase tjruwase 8 days ago
alanhuangyoo alanhuangyoo requested a review from tohtana tohtana 8 days ago
alanhuangyoo alanhuangyoo requested a review from loadams loadams 8 days ago
alanhuangyoo alanhuangyoo changed the title Keep a zero-element parameter's shape across the ZeRO-1/2 flat buffer A zero-element parameter loses its shape when it is bound to a flat buffer 8 days ago
alanhuangyoo
alanhuangyoo Keep a zero-element parameter's shape across the ZeRO-1/2 flat buffer
f9ec7632
alanhuangyoo Widen to every wrapper that binds parameters to a flat buffer
f23ef1da
alanhuangyoo alanhuangyoo force pushed from 09d6f71f to f23ef1da 8 days ago
alanhuangyoo Merge branch 'master' into fix/zero-numel-param-loses-shape
990c49cd
ebarkhordar
ebarkhordar commented on 2026-09-14
ebarkhordar
sfc-gh-truwase
alanhuangyoo
sfc-gh-truwase
alanhuangyoo
alanhuangyoo Merge master into fix/zero-numel-param-loses-shape
873ada7c
alanhuangyoo Leave zero-element parameters out of the optimizer groups, like froze…
f2d7d913
alanhuangyoo
sfc-gh-truwase
sfc-gh-truwase approved these changes on 2026-09-16
sfc-gh-truwase sfc-gh-truwase enabled auto-merge 2 days ago
alanhuangyoo Skip the zero-element parameter tests on dtypes the accelerator lacks
f2a23ba5
alanhuangyoo
disabled auto-merge 1 day ago
Head branch was pushed to by a user without write access

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone