Fix BF16_Optimizer being used without ZeRO #7790
fix(test): add bf16 model with fp32 grad_accum to supported configs
d5d87d77
revert changes in test and remove conditional branch in engine
64b10739
tohtana
changed the title Add bf16 model with fp32 grad_accum to supported configs Fix BF16_Optimizer being used without ZeRO 146 days ago
Merge branch 'master' into tohtana/fix_ds_initialize_test_bf16_fp32
50be5f33
tohtana
enabled auto-merge (squash) 146 days ago
tohtana
merged
09885efe
into master 146 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub