text-generation-inference

cea6051e - feat(launcher): Pass CUDA_VISIBLE_DEVICES to the shard