DeepSpeed
Z3: Support for activation ckpt with frozen params
#8148

Merged

Z3: Support for activation ckpt with frozen params #8148

sfc-gh-truwase merged 15 commits into master from sfc-gh-truwase/ds_8130

sfc-gh-truwase requested a review from

tohtana 50 days ago

sfc-gh-truwase requested a review from

tjruwase 50 days ago

sfc-gh-truwase changed the title ~~Sfc gh truwase/ds 8130~~ Z3: Support for activation ckpt with frozen params 50 days ago

chatgpt-codex-connector commented on 2026-07-16

sfc-gh-truwase force pushed from 29c461f3 to e72bfd01 50 days ago

sfc-gh-truwase requested a review from

loadams 49 days ago

Z3 activation-ckpt with frozen params

6920dd99

cleanup

e8557525

Cleanup

b6ec6521

fix data race

c838dacd

formatting

6f5a024b

Fix frozen-param release edge cases in ZeRO-3 activation checkpointing

56593d2a

Add tothana's UT

335e93de

sfc-gh-truwase force pushed from eb7a3f82 to 335e93de 47 days ago

Silence ZeRO param-coordinator debug prints (force=False)

62a175fa

Formatting

8dd26ae8

Skip fp16 lifecycle test when accelerator lacks fp16 support

93a1f1fe

Fix persistent params bug

e25efa89

Merge branch 'master' into sfc-gh-truwase/ds_8130

d71885aa

Frozen param filter

5c6924c1

Merge branch 'sfc-gh-truwase/ds_8130' of https://github.com/deepspeed…

7739de45

Keep persistent frozen params resident during activation-ckpt recompute

a78dd6e9

tohtana approved these changes on 2026-07-22

sfc-gh-truwase merged a31eb316 into master 45 days ago

sfc-gh-truwase deleted the sfc-gh-truwase/ds_8130 branch 45 days ago

Reviewers

tohtana

chatgpt-codex-connector

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Z3: Support for activation ckpt with frozen params #8148 Merged

Z3: Support for activation ckpt with frozen params #8148

DeepSpeed
Z3: Support for activation ckpt with frozen params
#8148

Merged