text-generation-inference
77a36d45
- nix: experimental support for building a Docker image
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
nix: experimental support for building a Docker image Run using something like: ``` docker run \ --device nvidia.com/gpu=all \ -it --rm -p 8080:80 \ -v $PWD/data:/data \ -v $PWD/tmp:/tmp \ tgi-docker:latest \ --model-id <model_id> ```
References
#2470 - nix: experimental support for building a Docker container
Author
danieldk
Committer
danieldk
Parents
5b6b74e2
Loading