DeepSpeed
BF16 optimizer: Improve device utilization by immediate grad update
#4975
Merged

Commits
  • BF16 optimizer: Improve device utilization by immediate grad update
    deepcharm committed 2 years ago
  • Update bf16_optimizer.py
    deepcharm committed 2 years ago
  • Update config.py
    deepcharm committed 2 years ago
  • Merge branch 'master' into bf16-optim-immediate-grad-update
    deepcharm committed 2 years ago
  • Merge branch 'master' into bf16-optim-immediate-grad-update
    deepcharm committed 2 years ago
  • Merge branch 'master' into bf16-optim-immediate-grad-update
    tjruwase committed 2 years ago
Loading