DeepSpeed
Samyamr/stage 3 skip modules without parameters
#922
Merged

Commits
  • Stage 3 Register only modules with parameters
    samyam committed 5 years ago
  • Runs as before but it should prevent registering modules that do not have any parameters
    samyam committed 5 years ago
  • Resetting step at the beginning of the forward
    samyam committed 5 years ago
Loading