DeepSpeed
ad5d427b - Add geglu

Commit

2 years ago

Add geglu

Author

cmikeh2

cmikeh2

Parents

Files4

csrc/transformer/inference
- csrc
  - gelu.cu
  - pt_binding.cpp
- includes
  - inference_cuda_layers.h
tests/unit/ops/transformer/inference
- test_bias_geglu.py