huggingface/text-generation-inference

Pull Requests Commits

fix: update test for tool_call_id in Message

drbh committed 318 days ago

e7215747

fix: bump openapi docs to include FunctionDefinition.id

drbh committed 318 days ago

042a6bc3

feat: align function id with tool call response

drbh committed 318 days ago

af78f46c

CI: enable server tests for backends (#3128)

baptistecolle committed 319 days ago

Verified 2e60a8dd

configurable termination timeout (#3126)

ErikKaum committed 319 days ago

Verified e5503eba

Minor fixes. (#3125)

Narsil committed 321 days ago

Verified e497bc09

Intel docker. (#3121)

Narsil committed 321 days ago

Verified 67ce543e

Prepare for patch release. (#3124)

Narsil committed 321 days ago

Verified 83fe45c1

Publish nix docker image. (#3122)

Narsil committed 321 days ago

Verified 11f2eec1

Bug Fix: Sliding Window Attention (#3112)

mht-sharma committed 321 days ago

Verified a35fbdb9

Gaudi: Sync TGI with the latest changes from the TGI-Gaudi fork (#3117)

baptistecolle committed 321 days ago

Verified 8c2c348f

launcher: correctly get the head dimension for VLMs (#3116)

danieldk committed 322 days ago

Verified 095775e0

xpu 2.6 update (#3051)

sywangyi committed 322 days ago

Verified 0b3e3db0

Make the Nix-based Docker container work on non-NixOS (#3109)

danieldk committed 326 days ago

Verified f91434e9

Fixing the docker build. (#3108)

Narsil committed 326 days ago

Verified 8b91f929

Release of Gaudi Backend for TGI (#3091)

baptistecolle committed 326 days ago

Verified 27ed8486

We need gcc during runtime to enable triton to compile kernels. (#3103)

Narsil committed 326 days ago

Verified 83ef3641

Router: add `gemma3-text` model type (#3107)

danieldk committed 326 days ago

Verified 83b7b7bb

Update to `kernels` 0.2.1 (#3084)

danieldk committed 326 days ago

Verified c73ae0bd

Try to fix on main CI color. (#3101)

Narsil committed 327 days ago

Verified d4c6faa6

Preparing relase 3.2.0 (#3100)

Narsil committed 327 days ago

Verified 4ac06ddf

Update neuron backend (#3098)

dacorvo committed 327 days ago

Verified f01dc9e7

Fix tool call4 (#3094)

Narsil committed 327 days ago

Verified 5c5528e3

Add gemma3 model (#3099)

mht-sharma committed 327 days ago

Verified ed46c2c4

Fix tool call3 (#3086)

Narsil committed 327 days ago

Verified f74c36fe

Update README.md (#3095)

celsowm committed 328 days ago

Verified ae4451c3

Fix qwen vl (#3096)

Narsil committed 328 days ago

Verified b447f7e8

Update the llamacpp backend (#3022)

angt committed 328 days ago

Verified 094975c3

Pr 3003 ci branch (#3007)

drbh committed 329 days ago

Verified dc5f05f8

hotfix: qwen2 formatting (#3093)

danieldk committed 329 days ago

Verified 124398fa

Older