text-generation-inference

Updating the benchmarks so everyone uses openai compat layer.

#1800

Merged