transformers

cf3fda19 - [CB] Keep order of incoming requests (#43626)

[CB] Keep order of incoming requests (#43626) * CB now keeps the order of incoming requests despite sorting * Fix test order * Add reordering for generate batch * Lower nb of generated tokens and add details