huggingface/text-generation-inference

Pull Requests Commits

Update to kernels 0.2.0.

Narsil committed 1 year ago

Verified 73ee7837

Try to fix on main CI color. (#3101)

Narsil committed 1 year ago

Verified d4c6faa6

Preparing relase 3.2.0 (#3100)

Narsil committed 1 year ago

Verified 4ac06ddf

Update neuron backend (#3098)

dacorvo committed 1 year ago

Verified f01dc9e7

Fix tool call4 (#3094)

Narsil committed 1 year ago

Verified 5c5528e3

Add gemma3 model (#3099)

mht-sharma committed 1 year ago

Verified ed46c2c4

Fix tool call3 (#3086)

Narsil committed 1 year ago

Verified f74c36fe

Update README.md (#3095)

celsowm committed 1 year ago

Verified ae4451c3

Fix qwen vl (#3096)

Narsil committed 1 year ago

Verified b447f7e8

Update the llamacpp backend (#3022)

angt committed 1 year ago

Verified 094975c3

Pr 3003 ci branch (#3007)

drbh committed 1 year ago

Verified dc5f05f8

hotfix: qwen2 formatting (#3093)

danieldk committed 1 year ago

Verified 124398fa

Small test and typing fixes (#3078)

danieldk committed 1 year ago

Verified c5ecc7a4

Add modules_to_not_convert in quantized model (#3053)

jiqing-feng committed 1 year ago

Verified cae0cbe8

Add qwen2 multi lora layers support (#3089)

EachSheep committed 1 year ago

Verified bbe218a4

Add request parameters to OTel span for `/v1/chat/completions` endpoint (#3000)

aW3st committed 1 year ago

Verified 58a65f79

Nix: the launcher needs a Python env with Torch for GPU detection (#3085)

danieldk committed 1 year ago

Verified 976eae21

Fix tool call2 (#3076)

Narsil committed 1 year ago

Verified 622908de

Update `--max-batch-total-tokens` description (#3083)

alvarobartt committed 1 year ago

Verified 55a66184

Nix: add `openai` to impure shell for integration tests (#3081)

danieldk committed 1 year ago

Verified 036d802b

Making `tool_calls` a vector. (#3075)

Narsil committed 1 year ago

Verified 8e92942a

Revert "Trying to reduce the logs in the case of errors."

Narsil committed 1 year ago

Verified 3208d1cd

Trying to reduce the logs in the case of errors.

Narsil committed 1 year ago

Verified cdf70d6a

Making sure Olmo (transformers backend) works. (#3074)

Narsil committed 1 year ago

Verified ab9dafc6

Force upgrade transformers version for olmo.

Narsil committed 1 year ago

Verified 31766dad

Only add token when it is defined. (#3073)

Narsil committed 1 year ago

Verified ec35976f

fix(neuron): explicitly install toolchain (#3072)

dacorvo committed 1 year ago

Verified cb42b3ad

Patch rust release. (#3069)

Narsil committed 1 year ago

Verified 491ed9e1

Fix a tiny typo in `monitoring.md` tutorial (#3056)

sadra-barikbin committed 1 year ago

Verified 144d99c1

Preparing for release. (#3060)

Narsil committed 1 year ago

Verified 08bbfa16

Older