text-generation-inference
77a36d45 - nix: experimental support for building a Docker image

Commit
1 year ago
nix: experimental support for building a Docker image Run using something like: ``` docker run \ --device nvidia.com/gpu=all \ -it --rm -p 8080:80 \ -v $PWD/data:/data \ -v $PWD/tmp:/tmp \ tgi-docker:latest \ --model-id <model_id> ```
Author
Committer
Parents
Loading