huggingface/text-generation-inference

Pull Requests Commits

feat(launcher): parse all shard logs

OlivierDehaene committed 2 years ago

7caea425

fix(docker): revert dockerfile changes

OlivierDehaene committed 2 years ago

4096ca4e

fix(docker): fix image (#185)

OlivierDehaene committed 2 years ago

Verified f9047562

fix(docker): fix docker image (#184)

OlivierDehaene committed 2 years ago

Verified 1bb39463

fix(ci): fix cosign error (#183)

OlivierDehaene committed 2 years ago

Verified 01c0e368

fea(dockerfile): better layer caching (#159)

OlivierDehaene committed 2 years ago

Verified 53ee09c0

fix(ci): fix ci permissions (#181)

OlivierDehaene committed 2 years ago

Verified 12e5633c

feat(ci): faster scanning (#180)

OlivierDehaene committed 2 years ago

Verified c1e2ea3b

feat(ci): use large runners (#179)

OlivierDehaene committed 2 years ago

Verified 13f1cd02

feat(ci): add Trivy and scan docker image (#178)

OlivierDehaene committed 2 years ago

Verified 9683c37b

feat(ci): add image signing with cosign (#175)

OlivierDehaene committed 2 years ago

Verified 643a39d5

fix(ci): fix CVE in github-slug-action (#174)

OlivierDehaene committed 2 years ago

Verified 64347b05

fix(launcher): revert change on shard errors (#173)

OlivierDehaene committed 2 years ago

Verified e3a63b6f

feat(server): support sharded santacoder (#167)

OlivierDehaene committed 2 years ago

Verified 880a76ee

feat(server): optimize decode for sane tokenizers (#170)

OlivierDehaene committed 2 years ago

Verified 5fa8ae04

OlivierDehaene committed 2 years ago

Verified 6f0f1d70

feat(server): support OPT models (#55)

OlivierDehaene committed 2 years ago

Verified f26dfd0d

feat(server): add flash attention llama (#144)

OlivierDehaene committed 2 years ago

Verified 299217c9

feat(router): make router input validation optional (#164)

OlivierDehaene committed 2 years ago

Verified 99879600

fix(router): use buckets for metrics histograms (#163)

OlivierDehaene committed 2 years ago

Verified 7dec65a2

fix(rust-client): use join_all instead of select_all to hopefully fix nccl issues (#162)

OlivierDehaene committed 2 years ago

Verified 5cddc055

feat(launcher): allow disabling hf_transfer (#161)

OlivierDehaene committed 2 years ago

Verified e63a21eb

feat(docker): improve flash_attention caching (#160)

OlivierDehaene committed 2 years ago

Verified 1883d8ec

fix(server): fix escape characters in stop sequence (#155)

OlivierDehaene committed 2 years ago

Verified 3f2542bb

docs(readme): provide link Logits Warper README (#154)

guspan-tanadi committed 2 years ago

Verified 9122e7bd

feat(server): flash santacoder (#153)

OlivierDehaene committed 2 years ago

Verified c0aeb325

OlivierDehaene committed 2 years ago

Verified fef1a1c3

OlivierDehaene committed 2 years ago

Verified 84722f3e

fix(server): fix flash neox rotary embeddings (#150)

OlivierDehaene committed 2 years ago

Verified 08b7e4a2

feat(benchmark): tui based benchmarking tool (#149)

OlivierDehaene committed 2 years ago

Verified 610bb1f9

Older