DeepSpeed
Preserve tensor learning rates across scheduler updates
#8202

Merged

Preserve tensor learning rates across scheduler updates #8202

delock merged 2 commits into deepspeedai:master from n33levo:nsarkar/preserve-tensor-lr

Preserve tensor learning rates in schedulers

80d036c9

n33levo requested a review from

tjruwase 88 days ago

n33levo requested a review from

tohtana 88 days ago

n33levo requested a review from

loadams 88 days ago

chatgpt-codex-connector commented on 2026-08-01

Preserve tensor base LRs in cosine scheduler

fc6105ab

sfc-gh-truwase approved these changes on 2026-08-02

delock merged 3b641487 into master 87 days ago

Reviewers

sfc-gh-truwase

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone