huggingface/text-generation-inference

Pull Requests Commits

Narsil committed 2 years ago

c10c4a02

Narsil committed 2 years ago

62613371

Narsil committed 2 years ago

cf10a72a

Monioring your deployements.

Narsil committed 2 years ago

ed6af32a

Different layout ?

Narsil committed 2 years ago

15267553

Different inclusion.

Narsil committed 2 years ago

331652f5

Adding a dashboard in the README to showcase prod metrics.

Narsil committed 2 years ago

3016997a

Updating tokenizers. (#1517)

Narsil committed 2 years ago

Verified 0e97af45

fix: tokenizer config should use local model path when possible (#1518)

drbh committed 2 years ago

Verified ee1cf51c

Revert "Modify default for max_new_tokens in python client (#1336)"

Narsil committed 2 years ago

1e03b61b

Hotfix the / health - route. (#1515)

Narsil committed 2 years ago

Verified 9ad7b6a1

Freshen up the README.

Narsil committed 2 years ago

94d243b3

GPTNeoX: Use static rotary embedding (#1498)

dwyatte committed 2 years ago

Verified 13c62be4

fix: improve messages api docs content and formatting (#1506)

drbh committed 2 years ago

Verified 2ae36a97

feat: eetq gemv optimization when batch_size <= 4 (#1502)

dtlzhuangz committed 2 years ago

Verified 0595bf3e

Modify default for max_new_tokens in python client (#1336)

freitng committed 2 years ago

Verified 2d56f106

Create the compute type at launch time (if not provided in the env). (#1505)

Narsil committed 2 years ago

Verified a9ea6068

Sending compute type from the environment instead of hardcoded string (#1504)

Narsil committed 2 years ago

Verified 0424dabb

Fixing top_n_tokens. (#1497)

Narsil committed 2 years ago

Verified 069895b9

OlivierDehaene committed 2 years ago

Verified c2d4a3b5

feat: add tokenizer-config-path to launcher args (#1495)

drbh committed 2 years ago

Verified d9758851

GPTQ support on ROCm (#1489)

fxmarty committed 2 years ago

Verified 650fea18

Update the docs to include newer models. (#1492)

Narsil committed 2 years ago

Verified ebecc061

fix: launcher doc typos (#1462)

thelinuxkid committed 2 years ago

Verified 50a20a83

Trying to fix that flaky test. (#1491)

Narsil committed 2 years ago

Verified 4c7315dd

Add sealion mpt support (#1477)

Narsil committed 2 years ago

Verified ac499727

Reinstate exl2 with tp (#1490)

Narsil committed 2 years ago

Verified b9573218

fix: launcher doc typos (#1473)

Narsil committed 2 years ago

Verified 16958fe3

fix: show warning with tokenizer config parsing error (#1488)

drbh committed 2 years ago

Verified 13dd8e23

Update the docs

Narsil committed 2 years ago

17b7b75e

Older