DeepSpeed
dffb01e3 - fix parallel norm

Commit

2 years ago

fix parallel norm

References

Author

Reza Yazdani Aminabadi

Parents

Files3

csrc/transformer
- normalize_kernels.cu
- pt_binding.cpp
deepspeed/ops/transformer_kernels
- parallel_norm.py