huggingface/text-generation-inference

Pull Requests Commits

feat(router): drop requests when client closes the channel (#202)

OlivierDehaene committed 2 years ago

Verified 709d8936

feat(router): add git sha to info route (#208)

OlivierDehaene committed 2 years ago

Verified b6ee0ec7

fix(router): add auth token to get model info (#207)

OlivierDehaene committed 2 years ago

Verified 252f42c1

fix(docker): remove unused dependencies (#205)

OlivierDehaene committed 2 years ago

Verified 6837b2eb

fix(server): fix hf_transfer issue with private repos (#203)

OlivierDehaene committed 2 years ago

Verified 5d27f525

feat(server): check cuda capability when importing flash models (#201)

OlivierDehaene committed 2 years ago

Verified a88c54bb

feat(server): support quantization for flash models (#200)

OlivierDehaene committed 2 years ago

Verified e14ae3b5

feat(router): add info route (#196)

OlivierDehaene committed 2 years ago

Verified 2475aede

feat(python-client): get list of currently deployed tgi models using the inference API (#191)

OlivierDehaene committed 2 years ago

Verified b927244e

fix(router): fix truncation (#190)

OlivierDehaene committed 2 years ago

Verified c13b9d87

fix(docker): fix docker image dependencies (#187)

OlivierDehaene committed 2 years ago

Verified 7a1ba585

fix(docker): revert dockerfile changes (#186)

OlivierDehaene committed 2 years ago

Verified 379c5c4d

fix(docker): fix image (#185)

OlivierDehaene committed 2 years ago

Verified f9047562

fix(docker): fix docker image (#184)

OlivierDehaene committed 2 years ago

Verified 1bb39463

fix(ci): fix cosign error (#183)

OlivierDehaene committed 2 years ago

Verified 01c0e368

fea(dockerfile): better layer caching (#159)

OlivierDehaene committed 2 years ago

Verified 53ee09c0

fix(ci): fix ci permissions (#181)

OlivierDehaene committed 2 years ago

Verified 12e5633c

feat(ci): faster scanning (#180)

OlivierDehaene committed 2 years ago

Verified c1e2ea3b

feat(ci): use large runners (#179)

OlivierDehaene committed 2 years ago

Verified 13f1cd02

feat(ci): add Trivy and scan docker image (#178)

OlivierDehaene committed 2 years ago

Verified 9683c37b

feat(ci): add image signing with cosign (#175)

OlivierDehaene committed 2 years ago

Verified 643a39d5

fix(ci): fix CVE in github-slug-action (#174)

OlivierDehaene committed 2 years ago

Verified 64347b05

fix(launcher): revert change on shard errors (#173)

OlivierDehaene committed 2 years ago

Verified e3a63b6f

feat(server): support sharded santacoder (#167)

OlivierDehaene committed 2 years ago

Verified 880a76ee

feat(server): optimize decode for sane tokenizers (#170)

OlivierDehaene committed 2 years ago

Verified 5fa8ae04

OlivierDehaene committed 2 years ago

Verified 6f0f1d70

feat(server): support OPT models (#55)

OlivierDehaene committed 2 years ago

Verified f26dfd0d

feat(server): add flash attention llama (#144)

OlivierDehaene committed 2 years ago

Verified 299217c9

feat(router): make router input validation optional (#164)

OlivierDehaene committed 2 years ago

Verified 99879600

fix(router): use buckets for metrics histograms (#163)

OlivierDehaene committed 2 years ago

Verified 7dec65a2

Newer Older