DeepSpeed
c84bca37 - Memory Access Utility (#2276)

Commit

2 years ago

Memory Access Utility (#2276) Co-authored-by: Ammar Ahmad Awan <ammar.awan@microsoft.com>

References

#2276 - Memory Access Utility

Author

cmikeh2

cmikeh2

Parents

Files14

csrc
- includes
  - memory_access_utils.h
- transformer/inference
  - csrc
    - apply_rotary_pos_emb.cu
    - dequantize.cu
    - gelu.cu
    - normalize.cu
    - pt_binding.cpp
    - relu.cu
    - softmax.cu
    - transform.cu
  - includes
    - inference_context.h
    - inference_cublas_wrappers.h
    - inference_cuda_layers.h
op_builder
- transformer_inference.py
tests/unit/ops/transformer/inference
- test_bias_gelu.py