text-generation-inference

fix: prefer inplace softmax to avoid copy

#2661

Merged