DeepSpeed
644fea44 - fixing some bug in softmax kernel for batch_size>1

Commit

2 years ago

fixing some bug in softmax kernel for batch_size>1

References

#2083 - Add Inference support for running the BigScience-BLOOM Architecture

Author

Reza Yazdani

Parents

Files3

csrc/transformer/inference/csrc
- pt_binding.cpp
- softmax.cu
deepspeed/ops/transformer/inference
- transformer_inference.py