huggingface/text-generation-inference

Pull Requests Commits

Freshen up the README.

Narsil committed 1 year ago

94d243b3

GPTNeoX: Use static rotary embedding (#1498)

dwyatte committed 1 year ago

Verified 13c62be4

fix: improve messages api docs content and formatting (#1506)

drbh committed 1 year ago

Verified 2ae36a97

feat: eetq gemv optimization when batch_size <= 4 (#1502)

dtlzhuangz committed 1 year ago

Verified 0595bf3e

Modify default for max_new_tokens in python client (#1336)

freitng committed 1 year ago

Verified 2d56f106

Create the compute type at launch time (if not provided in the env). (#1505)

Narsil committed 1 year ago

Verified a9ea6068

Sending compute type from the environment instead of hardcoded string (#1504)

Narsil committed 1 year ago

Verified 0424dabb

Fixing top_n_tokens. (#1497)

Narsil committed 1 year ago

Verified 069895b9

OlivierDehaene committed 1 year ago

Verified c2d4a3b5

feat: add tokenizer-config-path to launcher args (#1495)

drbh committed 1 year ago

Verified d9758851

GPTQ support on ROCm (#1489)

fxmarty committed 1 year ago

Verified 650fea18

Update the docs to include newer models. (#1492)

Narsil committed 1 year ago

Verified ebecc061

fix: launcher doc typos (#1462)

thelinuxkid committed 1 year ago

Verified 50a20a83

Trying to fix that flaky test. (#1491)

Narsil committed 1 year ago

Verified 4c7315dd

Add sealion mpt support (#1477)

Narsil committed 1 year ago

Verified ac499727

Reinstate exl2 with tp (#1490)

Narsil committed 1 year ago

Verified b9573218

fix: launcher doc typos (#1473)

Narsil committed 1 year ago

Verified 16958fe3

fix: show warning with tokenizer config parsing error (#1488)

drbh committed 1 year ago

Verified 13dd8e23

Update the docs

Narsil committed 1 year ago

17b7b75e

fix: read stderr in download (#1486)

OlivierDehaene committed 1 year ago

Verified 9c320e26

feat: adds phi model (#1442)

drbh committed 1 year ago

Verified 7e2a7433

Add a new `/tokenize` route to get the tokenized input (#1471)

Narsil committed 1 year ago

Verified 86c8335f

Add messages api compatibility docs (#1478)

drbh committed 1 year ago

Verified 7872b8c5

Fixing non divisible embeddings. (#1476)

Narsil committed 1 year ago

Verified 7e542d4d

Disable `decoder_input_details` on OpenAI-compatible chat streaming, pass temp and top-k from API (#1470)

EndlessReform committed 1 year ago

Verified 82f87ada

feat: conditionally toggle chat on invocations route (#1454)

drbh committed 1 year ago

Verified 98e5faff

chore: bump rust version and annotate/fix all clippy warnings (#1455)

drbh committed 1 year ago

Verified becd0997

feat: support raise_exception, bos and eos tokens (#1450)

drbh committed 1 year ago

Verified 3ccb3bb0

feat: supports openai chat completions API (#1427)

drbh committed 1 year ago

Verified 0eabc835

Return prompt vs generated tokens. (#1436)

Narsil committed 1 year ago

Verified ac08b4ef

Older