huggingface/text-generation-inference

Pull Requests Commits

Narsil committed 1 year ago

81fa53f3

Narsil committed 1 year ago

40f693b6

Narsil committed 1 year ago

29a8d5a3

Adding batch_dimension_flag (to be used for Neuron other forced padding targets).

Narsil committed 1 year ago

e1dc1681

feat: add ie update to message docs (#1523)

drbh committed 1 year ago

Verified 0da00be5

[docs] Fix link to Install CLI (#1526)

pcuenca committed 1 year ago

Verified 3ab578b4

Updating tokenizers. (#1517)

Narsil committed 1 year ago

Verified 0e97af45

fix: tokenizer config should use local model path when possible (#1518)

drbh committed 1 year ago

Verified ee1cf51c

Revert "Modify default for max_new_tokens in python client (#1336)"

Narsil committed 1 year ago

1e03b61b

Hotfix the / health - route. (#1515)

Narsil committed 1 year ago

Verified 9ad7b6a1

Freshen up the README.

Narsil committed 1 year ago

94d243b3

GPTNeoX: Use static rotary embedding (#1498)

dwyatte committed 1 year ago

Verified 13c62be4

fix: improve messages api docs content and formatting (#1506)

drbh committed 1 year ago

Verified 2ae36a97

feat: eetq gemv optimization when batch_size <= 4 (#1502)

dtlzhuangz committed 1 year ago

Verified 0595bf3e

Modify default for max_new_tokens in python client (#1336)

freitng committed 1 year ago

Verified 2d56f106

Create the compute type at launch time (if not provided in the env). (#1505)

Narsil committed 1 year ago

Verified a9ea6068

Sending compute type from the environment instead of hardcoded string (#1504)

Narsil committed 1 year ago

Verified 0424dabb

Fixing top_n_tokens. (#1497)

Narsil committed 1 year ago

Verified 069895b9

OlivierDehaene committed 1 year ago

Verified c2d4a3b5

feat: add tokenizer-config-path to launcher args (#1495)

drbh committed 1 year ago

Verified d9758851

GPTQ support on ROCm (#1489)

fxmarty committed 1 year ago

Verified 650fea18

Update the docs to include newer models. (#1492)

Narsil committed 1 year ago

Verified ebecc061

fix: launcher doc typos (#1462)

thelinuxkid committed 1 year ago

Verified 50a20a83

Trying to fix that flaky test. (#1491)

Narsil committed 1 year ago

Verified 4c7315dd

Add sealion mpt support (#1477)

Narsil committed 1 year ago

Verified ac499727

Reinstate exl2 with tp (#1490)

Narsil committed 1 year ago

Verified b9573218

fix: launcher doc typos (#1473)

Narsil committed 1 year ago

Verified 16958fe3

fix: show warning with tokenizer config parsing error (#1488)

drbh committed 1 year ago

Verified 13dd8e23

Update the docs

Narsil committed 1 year ago

17b7b75e

fix: read stderr in download (#1486)

OlivierDehaene committed 1 year ago

Verified 9c320e26

Older