text-generation-inference

78f87d5a - Temporary implem of torch.compile on our stuff.