text-generation-inference

We can have a tokenizer anywhere.

#2527

Merged