DeepSpeed
BF16 optimizer for BF16+ZeRO Stage 1
#2706
Merged
Overview
Commits
6
Changes
View On GitHub
Commits
  • BF16 optimizer only with ZeRO stage 1.
    jomayeri committed 2 years ago
  • Merge branch 'master' into jomayeri/bf16-zero1
    tjruwase committed 2 years ago
  • Merge branch 'master' into jomayeri/bf16-zero1
    tjruwase committed 2 years ago
  • Updating to grad accum of fp32 for BF16 ZeRO1 case.
    jomayeri committed 2 years ago
  • Merge branch 'master' into jomayeri/bf16-zero1
    tjruwase committed 2 years ago
  • Merge branch 'master' into jomayeri/bf16-zero1
    jomayeri committed 2 years ago
FAQ Terms Privacy Refunds Impressum
Loading