DeepSpeed
f3b3d491 - initial changes for CUDA-Graph support

Commit

3 years ago

initial changes for CUDA-Graph support

Author

Reza Yazdani

Parents

Files4

DeepSpeedExamples
csrc/transformer/inference
- csrc
  - pt_binding.cpp
- includes
  - custom_cuda_layers.h
deepspeed/ops/transformer/inference
- transformer_inference.py