custom_cuda_layers.h
DeepSpeed
f26900ec - Modify normalize kernels to save variance in floating-point for backward
Commit
3 years ago
- Files6
- csrc
- includes
- ds_transformer_cuda.h
- normalize_layer.h
- transformer
ds_transformer_cuda.cpp
normalize_kernels.cu
- deepspeed/ops/transformer
transformer.py