DeepSpeed
Fix bug in bfloat16 optimizer related to checkpointing
#4434

Merged

Fix bug in bfloat16 optimizer related to checkpointing #4434

tjruwase merged 10 commits into deepspeedai:master from okoge-kaz:fix/bf16-optimizer-state

fix: bf16 optimizer if condition

0254fbfa

okoge-kaz requested a review from

jeffra 2 years ago

okoge-kaz requested a review from

tjruwase 2 years ago

fix: unexpected keyword argument 'load_serial'

c03a6cff

okoge-kaz changed the title ~~Fix a bug in bfloat16 optimizer when saving checkpoints.~~ Fix bug in bfloat16 optimizer when saving checkpoints. 2 years ago

okoge-kaz changed the title ~~Fix bug in bfloat16 optimizer when saving checkpoints.~~ Fix bug in bfloat16 optimizer related checkpointing 2 years ago

okoge-kaz changed the title ~~Fix bug in bfloat16 optimizer related checkpointing~~ Fix bug in bfloat16 optimizer related to checkpointing 2 years ago

tjruwase commented on 2023-10-03

fix: add load_serial arg to bf16_optimizer

4422e131

style: fix indentation

ab6a8c7b