DeepSpeed

[inference] test suite for ds-kernels (bert, roberta, gpt2, gpt-neo, gpt-j)

#1992

Merged