DeepSpeed
_exec_forward_pass: place zeros(1) on the same device as the param
#5576
Merged

Commits
  • _exec_forward_pass: place zeros(1) on the same device as the param
    Nadav Elyahu committed 2 years ago
  • Merge branch 'master' into pipe_zero_device
    loadams committed 2 years ago
  • Merge branch 'master' into pipe_zero_device
    loadams committed 2 years ago
  • Merge branch 'master' into pipe_zero_device
    loadams committed 2 years ago
Loading