DeepSpeed
Fix BF16_Optimizer being used without ZeRO
#7790
Merged

Fix BF16_Optimizer being used without ZeRO #7790

tohtana
tohtana fix(test): add bf16 model with fp32 grad_accum to supported configs
d5d87d77
tohtana tohtana requested a review from tjruwase tjruwase 149 days ago
tohtana tohtana requested a review from loadams loadams 149 days ago
sfc-gh-truwase
tohtana
sfc-gh-truwase
tohtana
sfc-gh-truwase
tohtana revert changes in test and remove conditional branch in engine
64b10739
tohtana
tohtana
sfc-gh-truwase
sfc-gh-truwase approved these changes on 2026-01-20
sfc-gh-truwase
tohtana tohtana changed the title Add bf16 model with fp32 grad_accum to supported configs Fix BF16_Optimizer being used without ZeRO 146 days ago
tohtana Merge branch 'master' into tohtana/fix_ds_initialize_test_bf16_fp32
50be5f33
tohtana tohtana enabled auto-merge (squash) 146 days ago
tohtana tohtana merged 09885efe into master 146 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone