transformers

8213e0d9 - CB improvements for serving (#45063)

CB improvements for serving (#45063) * merge * update * fix * style * simpler * style * review ! * style * batch output * style * type