DeepSpeed
Describe universal checkpoint shards as affine maps
#8385
Merged

Describe universal checkpoint shards as affine maps #8385

Achyuthan-S
Achyuthan-S Achyuthan-S requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 25 days ago
Achyuthan-S Achyuthan-S requested a review from tjruwase tjruwase 25 days ago
Achyuthan-S Achyuthan-S requested a review from loadams loadams 25 days ago
Achyuthan-S Achyuthan-S requested a review from tohtana tohtana 25 days ago
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-09-01
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-09-01
Achyuthan-S Achyuthan-S force pushed from afab92bf to 57695440 25 days ago
Achyuthan-S
delock delock requested a review from delock delock 25 days ago
Achyuthan-S
delock
delock commented on 2026-09-04
delock
delock commented on 2026-09-04
delock
Achyuthan-S Achyuthan-S force pushed from 57695440 to 35eb2e23 22 days ago
Achyuthan-S
0z5a
Achyuthan-S Add affine shard map for universal checkpoint
b6b0d505
Achyuthan-S Add scale and homogeneity to the affine shard map
13e2c649
Achyuthan-S Lower the current checkpoint metadata to affine maps
1d1d6039
Achyuthan-S Convert tp slices through an affine map when one is present
3cf12341
Achyuthan-S Build shard metadata per model in the affine map tests
166a3d2f
Achyuthan-S Refuse an affine map format newer than the reader understands
91499088
Achyuthan-S Keep the stride helper private
d63251bb
Achyuthan-S Address review: scale optimizer states by their own power
2e846d91
Achyuthan-S Address review: header, scale in the piece tuple, scaling example
fcec0621
Achyuthan-S Refuse to convert a scaled optimizer state
10bde3e7
Achyuthan-S Achyuthan-S force pushed from 35eb2e23 to 10bde3e7 17 days ago
Achyuthan-S
Achyuthan-S
0z5a
delock
delock
delock
delock approved these changes on 2026-09-10
Achyuthan-S Carry the scale on the replicated map, not the split
d02c56bf
0z5a Fix universal checkpoint resume across AutoTP sizes
dd5c57f1
Achyuthan-S
Achyuthan-S
delock delock merged 11909466 into master 16 days ago
delock

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone