text-generation-inference

343437c7 - feat(router): add device and dtype info (#215)