DeepSpeed
65535583 - add new APIs to optimize megatron-LM

Commit
4 years ago
add new APIs to optimize megatron-LM
Author
Reza Yazdani
Parents
  • csrc
    • includes
      • File
        ds_transformer_cuda.h
    • transformer
      • File
        ds_transformer_cuda.cpp
  • deepspeed
    • File
      __init__.py
    • pt
      • File
        deepspeed_cuda.py
  • tests/unit
    • File
      modelingpreln.py
    • File
      test_cuda_backward.py
    • File
      test_cuda_forward.py