DeepSpeed
A zero-element parameter loses its shape when it is bound to a flat buffer
#8467
Merged

A zero-element parameter loses its shape when it is bound to a flat buffer #8467

alanhuangyoo
alanhuangyoo alanhuangyoo requested a review from tjruwase tjruwase 31 days ago
alanhuangyoo alanhuangyoo requested a review from tohtana tohtana 31 days ago
alanhuangyoo alanhuangyoo requested a review from loadams loadams 31 days ago
alanhuangyoo alanhuangyoo changed the title Keep a zero-element parameter's shape across the ZeRO-1/2 flat buffer A zero-element parameter loses its shape when it is bound to a flat buffer 31 days ago
alanhuangyoo
alanhuangyoo Keep a zero-element parameter's shape across the ZeRO-1/2 flat buffer
f9ec7632
alanhuangyoo Widen to every wrapper that binds parameters to a flat buffer
f23ef1da
alanhuangyoo alanhuangyoo force pushed from 09d6f71f to f23ef1da 31 days ago
alanhuangyoo Merge branch 'master' into fix/zero-numel-param-loses-shape
f080192b
ebarkhordar
ebarkhordar commented on 2026-09-14
ebarkhordar
sfc-gh-truwase
alanhuangyoo
sfc-gh-truwase
alanhuangyoo
alanhuangyoo Merge master into fix/zero-numel-param-loses-shape
851ccb1b
alanhuangyoo Leave zero-element parameters out of the optimizer groups, like froze…
36953969
alanhuangyoo
sfc-gh-truwase
sfc-gh-truwase approved these changes on 2026-09-16
sfc-gh-truwase sfc-gh-truwase enabled auto-merge 24 days ago
alanhuangyoo Skip the zero-element parameter tests on dtypes the accelerator lacks
6627461b
alanhuangyoo
disabled auto-merge 24 days ago
Head branch was pushed to by a user without write access
alanhuangyoo Merge master into fix/zero-numel-param-loses-shape
6395f162
alanhuangyoo
alanhuangyoo alanhuangyoo force pushed from 9cb907b3 to 6395f162 19 days ago
alanhuangyoo
sfc-gh-truwase Merge branch 'master' into fix/zero-numel-param-loses-shape
dc0af847
sfc-gh-truwase sfc-gh-truwase enabled auto-merge 16 days ago
sfc-gh-truwase
sfc-gh-truwase sfc-gh-truwase merged ca7455ef into master 16 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone