huggingface/text-generation-inference

Pull Requests Commits
fix(models): Revert buggy support for AutoModel
OlivierDehaene committed 3 years ago
755fc0e4
feat: Use json formatter by default in docker image
OlivierDehaene committed 3 years ago
b3b7ea0d
feat(server): Support all AutoModelForCausalLM on a best effort basis
OlivierDehaene committed 3 years ago
3cf6368c
feat(server): Support bitsandbytes
OlivierDehaene committed 3 years ago
09674e6d
feat(client): Simplify sharded logic
OlivierDehaene committed 3 years ago
beb55212
feat(server): Use safetensors
Narsil committed 3 years ago
Verified c8ce9b25
Create LICENSE (#2)
thomasw21 committed 3 years ago
Verified be8827fe
feat(router): Add max_waiting_tokens
OlivierDehaene committed 3 years ago
c8378933
fix(validation): Fix error messages
OlivierDehaene committed 3 years ago
895a341d
v0.1.0
OlivierDehaene committed 3 years ago
f16f2f5a
feat: Add arguments to CLI
OlivierDehaene committed 3 years ago
92c1ecd0
feat: Improve error handling
OlivierDehaene committed 3 years ago
5e5d8766
Update aml deployment
OlivierDehaene committed 3 years ago
00e6ce44
feat: Add AML deployment
OlivierDehaene committed 3 years ago
bcb53903
feat: Docker image
OlivierDehaene committed 3 years ago
bf99afe9
Use axum
OlivierDehaene committed 3 years ago
39df4d99
ValidationError was not correctly handled
OlivierDehaene committed 3 years ago
e86ecbac
Refactored gRPC interface
OlivierDehaene committed 3 years ago
4c693e65
Add load testing
OlivierDehaene committed 3 years ago
fa9a0884
fix: cleanup
OlivierDehaene committed 3 years ago
1d986983
Init
OlivierDehaene committed 3 years ago
295831a4
Terms Of Use Privacy Policy Refund Policy Impressum