text-generation-inference

ebc74d56 - feat(router): use number of tokens in batch as input for dynamic batching (#226)