optimizer states
#7700

Merged

Low-precision master params/grads/optimizer states #7700

tohtana merged 13 commits into deepspeedai:master from tohtana:tohtana/pure_bf16_config

add options for pure bf16

a4c63626

add low precision master weight mode

b5dcaa84

allow fp16+z1

dbd39ae2

test combination with autocast

88e0bbdf

update document

31369929

tohtana marked this pull request as ready for review 34 days ago

tohtana requested a review from

tjruwase 34 days ago

tohtana requested a review from

loadams 34 days ago

Merge branch 'master' into tohtana/pure_bf16_config

54316e49

fix formatting

a2f69418

Merge branch 'master' into tohtana/pure_bf16_config

dc1f4a79

sfc-gh-truwase commented on 2025-12-02

sfc-gh-truwase approved these changes on 2025-12-02

Merge branch 'master' into tohtana/pure_bf16_config

886b1fc0

add comment

71ac2af3

simplify description in config json

5400979e

fix sphinx format issue (subsections not rendered)

c70e15b1

Merge branch 'master' into tohtana/pure_bf16_config

769339ca

tohtana enabled auto-merge (squash) 20 days ago

tohtana merged 39a682d7 into master 20 days ago

Reviewers

sfc-gh-truwase

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Low-precision master params/grads/optimizer states #7700 Merged

Low-precision master params/grads/optimizer states #7700

DeepSpeed
Low-precision master params/grads/optimizer states
#7700

Merged