text-generation-inference

b806a856 - Stream to make the builder image smaller

Stream to make the builder image smaller This avoids storing a Docker image tarball in the image. Instead, stream the layers while doing `docker run`.