DeepSpeed
Enable non-ZeRO mode
#7515
Merged

Enable non-ZeRO mode #7515

sfc-gh-truwase merged 22 commits into master from sfc-gh-truwase/disable_zero
sfc-gh-truwase
sfc-gh-truwase Enable non-ZeRO run
19db7813
sfc-gh-truwase torch.autocast docs
93814afd
sfc-gh-truwase sfc-gh-truwase requested a review from stas00 stas00 123 days ago
sfc-gh-truwase sfc-gh-truwase requested a review from tohtana tohtana 123 days ago
sfc-gh-truwase sfc-gh-truwase requested a review from sfc-gh-mwyatt sfc-gh-mwyatt 123 days ago
sfc-gh-truwase sfc-gh-truwase requested a review from tjruwase tjruwase 123 days ago
sfc-gh-truwase sfc-gh-truwase requested a review from loadams loadams 123 days ago
sfc-gh-truwase
sfc-gh-truwase Merge branch 'master' into sfc-gh-truwase/disable_zero
27ee9f6c
sfc-gh-truwase
sfc-gh-truwase Enable UT on modal
e114f2e1
sfc-gh-truwase Merge branch 'sfc-gh-truwase/disable_zero' of https://github.com/deep…
d8dde9fd
sfc-gh-truwase sfc-gh-truwase changed the title Enable non-ZeRO run Enable non-ZeRO mode 123 days ago
PKUWZP
Antlera
sfc-gh-truwase
sfc-gh-truwase
sfc-gh-truwase Enable DDP bf16 training
b97b870b
sfc-gh-truwase Fix dtype
4b8f9615
sfc-gh-truwase Fix UT
81c7bc53
sfc-gh-truwase Merge branch 'master' into sfc-gh-truwase/disable_zero
f914f612
sfc-gh-truwase Docs
865c3fa9
sfc-gh-truwase Docs
a12d1886
sfc-gh-truwase Docs
5db1e900
sfc-gh-truwase Docs
b7d77bd5
sfc-gh-truwase Docs
0a63b9c3
sfc-gh-truwase Docs
748e6159
sfc-gh-truwase Docs
ce74b7d1
stas00
stas00 approved these changes on 2025-08-27
sfc-gh-truwase Update docs/code-docs/source/training.rst
070746ad
sfc-gh-truwase Update docs/code-docs/source/training.rst
6097e3a4
sfc-gh-truwase Update docs/code-docs/source/training.rst
27b8fedb
sfc-gh-truwase Update docs/code-docs/source/training.rst
915ab4eb
sfc-gh-truwase Update docs/code-docs/source/training.rst
efee1111
sfc-gh-truwase Fix scaling assert
c4633341
sfc-gh-truwase sfc-gh-truwase merged 889f0ead into master 121 days ago
sfc-gh-truwase sfc-gh-truwase deleted the sfc-gh-truwase/disable_zero branch 121 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone