huggingface/text-generation-inference

Pull Requests Commits

OlivierDehaene committed 2 years ago

56de96ab

update launcher doc

OlivierDehaene committed 2 years ago

29341dcc

feat: support attention sinks

OlivierDehaene committed 2 years ago

cc36128c

Adding yarn support. (#1099)

Narsil committed 2 years ago

Verified 3c373dcc

Fixing GPTQ exllama kernel usage. (#1101)

Narsil committed 2 years ago

Verified 87f43814

fix: type hint typo in tokens.py (#1102)

vejvarm committed 2 years ago

Verified 0e4ee4f1

Modify the default for `max_new_tokens`. (#1097)

Narsil committed 2 years ago

Verified 6df43da0

Receive base64 encoded images for idefics. (#1096)

Narsil committed 2 years ago

Verified 66ce2fa7

Adding titles to CLI doc. (#1094)

Narsil committed 2 years ago

Verified 8ec1b87f

fixed command line arguments in docs (#1092)

Fluder-Paradyne committed 2 years ago

Verified b4f68c3c

Update idefics_image_processing.py (#1091)

Narsil committed 2 years ago

Verified 1bebb9e7

Handling bloom prefix. (#1090)

Narsil committed 2 years ago

Verified 85acb11b

[Doc page] Fix launcher page highlighting (#1080)

Mishig committed 2 years ago

Verified 702d2697

raise exception on invalid images (#999)

leot13 committed 2 years ago

Verified b8fefa6b

Fix window_size_left for flash attention v1 (#1089)

peterlowrance committed 2 years ago

Verified bd998d87

Fixing eetq dockerfile. (#1081)

Narsil committed 2 years ago

Verified 5ba53d44

Update launcher.md to wrap code blocks (#1076)

Mishig committed 2 years ago

Verified 724199aa

Fix launcher.md (#1075)

Mishig committed 2 years ago

Verified a7808ff8

OlivierDehaene committed 2 years ago

7a6fad6a

feat: add mistral model (#1071)

OlivierDehaene committed 2 years ago

Verified 3b56d766

Automatic docs for TGI (#1045)

merveenoyan committed 2 years ago

Verified 259a2300

Complete FastLinear.load parameters in OPTDecoder initialization (#1060)

zhangsibo1129 committed 2 years ago

Verified 1e3ec3c9

feat: format code (#1070)

OlivierDehaene committed 2 years ago

Verified 47954b81

Remove the stripping of the prefix space (and any other mangling that tokenizers might do). (#1065)

Narsil committed 2 years ago

Verified b32e9ce9

Support eetq weight only quantization (#1068)

Narsil committed 2 years ago

Verified 95a4bb69

Added note on weight-cache-override (#994)

merveenoyan committed 2 years ago

Verified 36c28688

Preping 1.1.0 (#1066)

Narsil committed 2 years ago

Verified a0498642

Fix top_n_tokens returning non-log probs for some models (#1023)

Vinno97 committed 2 years ago

Verified 8672cad2

Fix position ids logic instantiation of idefics vision part (#1064)

VictorSanh committed 2 years ago

Verified 1fff6746

Install curl to be able to perform more advanced healthchecks (#1033)

oOraph committed 2 years ago

Verified ae623b8d

Older