huggingface/text-generation-inference

Pull Requests Commits

fix(router): use buckets for metrics histograms (#163)

OlivierDehaene committed 2 years ago

Verified 7dec65a2

fix(rust-client): use join_all instead of select_all to hopefully fix nccl issues (#162)

OlivierDehaene committed 2 years ago

Verified 5cddc055

feat(launcher): allow disabling hf_transfer (#161)

OlivierDehaene committed 2 years ago

Verified e63a21eb

feat(docker): improve flash_attention caching (#160)

OlivierDehaene committed 2 years ago

Verified 1883d8ec

fix(server): fix escape characters in stop sequence (#155)

OlivierDehaene committed 2 years ago

Verified 3f2542bb

docs(readme): provide link Logits Warper README (#154)

guspan-tanadi committed 2 years ago

Verified 9122e7bd

feat(server): flash santacoder (#153)

OlivierDehaene committed 2 years ago

Verified c0aeb325

OlivierDehaene committed 2 years ago

Verified fef1a1c3

OlivierDehaene committed 2 years ago

Verified 84722f3e

fix(server): fix flash neox rotary embeddings (#150)

OlivierDehaene committed 2 years ago

Verified 08b7e4a2

feat(benchmark): tui based benchmarking tool (#149)

OlivierDehaene committed 2 years ago

Verified 610bb1f9

fix(ci): fix sagemaker action (#148)

OlivierDehaene committed 2 years ago

Verified 55106ec4

feat: aws sagemaker compatible image (#147)

OlivierDehaene committed 2 years ago

Verified d503e8f0

feat(server): reduce mlp and attn in one op for flash neox (#145)

OlivierDehaene committed 2 years ago

Verified c9bdaa8b

feat(server): clear cache on error (#143)

OlivierDehaene committed 2 years ago

Verified f0000689

feat(server): Add mypy-protobuf (#141)

njhill committed 2 years ago

Verified 8e8dd984

fix(server): Avoid using try/except to determine kind of AutoModel (#142)

njhill committed 2 years ago

Verified 462530c2

OlivierDehaene committed 2 years ago

Verified ab5fd8cf

feat(server): cleanup flash neox loading (#139)

OlivierDehaene committed 2 years ago

Verified 678b2f39

fix(server): fix flash-neox scores warping (#137)

OlivierDehaene committed 2 years ago

Verified d6a93fe9

feat(server): flash neoX (#133)

OlivierDehaene committed 2 years ago

Verified 05e9a796

feat(python-client): add CI (#136)

OlivierDehaene committed 2 years ago

Verified 23e10288

feat(python-client): release v0.4.0 (#135)

OlivierDehaene committed 2 years ago

Verified 5d04525c

feat: Add note about NVIDIA drivers (#64)

lewtun committed 2 years ago

Verified 5e5e9d4b

feat(ci): add ci paths (#134)

OlivierDehaene committed 2 years ago

Verified 603e20b5

feat(python-client): add cookies to Client constructors and requests (#132)

dconathan committed 2 years ago

Verified 78501190

fix(python-client): relax dependencies (#129)

OlivierDehaene committed 2 years ago

Verified a3b7db93

fix(server): use server tokenizer as gt (#128)

OlivierDehaene committed 2 years ago

Verified b49dbf2d

fix(server): add position ids to neox (#126)

OlivierDehaene committed 2 years ago

Verified 8ad60b75

fix(server): revert gpt-neox optims (#123)

OlivierDehaene committed 2 years ago

Verified cbd36aa4

Newer Older