DeepSpeed
Samyamr/zero offload correctness
#359
Merged
Overview
Commits
2
Changes
View On GitHub
Commits
  • fixing gradient accumulation for zero offload
    samyam committed 6 years ago
  • Bug fixes. ZeRO Stage 1,2 and Offload all produce the same loss with gradient accumulation step of 2
    samyam committed 6 years ago
FAQ Terms Privacy Refunds Impressum
Loading