text-generation-inference
f3c5d7d9 - nix: add default package (#2453)

Commit
1 year ago
nix: add default package (#2453) The default package wraps the launcher and puts the server/router in the path. As a result, TGI can be started using something like: ``` nix run .# -- \ --model-id hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 \ --port 8080 ```
Author
Parents
Loading