huggingface/text-generation-inference

Pull Requests Commits

Update to kernels 0.2.0.

Narsil committed 280 days ago

Verified 73ee7837

Try to fix on main CI color. (#3101)

Narsil committed 281 days ago

Verified d4c6faa6

Preparing relase 3.2.0 (#3100)

Narsil committed 281 days ago

Verified 4ac06ddf

Update neuron backend (#3098)

dacorvo committed 281 days ago

Verified f01dc9e7

Fix tool call4 (#3094)

Narsil committed 281 days ago

Verified 5c5528e3

Add gemma3 model (#3099)

mht-sharma committed 281 days ago

Verified ed46c2c4

Fix tool call3 (#3086)

Narsil committed 281 days ago

Verified f74c36fe

Update README.md (#3095)

celsowm committed 282 days ago

Verified ae4451c3

Fix qwen vl (#3096)

Narsil committed 282 days ago

Verified b447f7e8

Update the llamacpp backend (#3022)

angt committed 282 days ago

Verified 094975c3

Pr 3003 ci branch (#3007)

drbh committed 283 days ago

Verified dc5f05f8

hotfix: qwen2 formatting (#3093)

danieldk committed 283 days ago

Verified 124398fa

Small test and typing fixes (#3078)

danieldk committed 283 days ago

Verified c5ecc7a4

Add modules_to_not_convert in quantized model (#3053)

jiqing-feng committed 283 days ago

Verified cae0cbe8

Add qwen2 multi lora layers support (#3089)

EachSheep committed 283 days ago

Verified bbe218a4

Add request parameters to OTel span for `/v1/chat/completions` endpoint (#3000)

aW3st committed 283 days ago

Verified 58a65f79

Nix: the launcher needs a Python env with Torch for GPU detection (#3085)

danieldk committed 283 days ago

Verified 976eae21

Fix tool call2 (#3076)

Narsil committed 286 days ago

Verified 622908de

Update `--max-batch-total-tokens` description (#3083)

alvarobartt committed 286 days ago

Verified 55a66184

Nix: add `openai` to impure shell for integration tests (#3081)

danieldk committed 286 days ago

Verified 036d802b

Making `tool_calls` a vector. (#3075)

Narsil committed 288 days ago

Verified 8e92942a

Revert "Trying to reduce the logs in the case of errors."

Narsil committed 288 days ago

Verified 3208d1cd

Trying to reduce the logs in the case of errors.

Narsil committed 288 days ago

Verified cdf70d6a

Making sure Olmo (transformers backend) works. (#3074)

Narsil committed 288 days ago

Verified ab9dafc6

Force upgrade transformers version for olmo.

Narsil committed 288 days ago

Verified 31766dad

Only add token when it is defined. (#3073)

Narsil committed 288 days ago

Verified ec35976f

fix(neuron): explicitly install toolchain (#3072)

dacorvo committed 288 days ago

Verified cb42b3ad

Patch rust release. (#3069)

Narsil committed 289 days ago

Verified 491ed9e1

Fix a tiny typo in `monitoring.md` tutorial (#3056)

sadra-barikbin committed 289 days ago

Verified 144d99c1

Preparing for release. (#3060)

Narsil committed 289 days ago

Verified 08bbfa16

Older