DeepSpeed
optimize grad_norm calculation in stage3.py
#4436
Merged

Commits
  • optimize grad_norm calculation
    mmhab committed 3 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    tjruwase committed 3 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    tjruwase committed 3 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    tjruwase committed 2 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    mmhab committed 2 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    mmhab committed 2 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    mrwyattii committed 2 years ago
  • Update deepspeed/runtime/zero/stage3.py
    mrwyattii committed 2 years ago
  • Update deepspeed/runtime/zero/stage3.py
    mrwyattii committed 2 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    mrwyattii committed 2 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    tjruwase committed 2 years ago
  • optimize grad_norm calculation
    mmhab committed 2 years ago
  • Merge branch 'master' into optimize_grad_norm_calc
    GitHub committed 2 years ago
Loading