huggingface/text-generation-inference

Pull Requests Commits

flashinfer: head_dim -> head_dim_qk

danieldk committed 252 days ago

3d71c06a

Update to flashinfer 0.2.5

danieldk committed 252 days ago

e893362a

Fixing tokenization like https://github.com/huggingface/text-embeddin… (#3156)

Narsil committed 254 days ago

Verified 9a8d0462

Fixing Qwen 2.5 VL (32B). (#3157)

Narsil committed 254 days ago

Verified 5861da1a

Narsil committed 256 days ago

Verified 0b28aabb

fix: compute type typo (#3150)

oOraph committed 256 days ago

Verified 24bec29f

Gaudi: Add Integration Test for Gaudi Backend (#3142)

baptistecolle committed 256 days ago

Verified 37104acd

Update transformers to 4.51 (#3148)

mht-sharma committed 256 days ago

Verified 87a0af4e

Use ROCM 6.3.1 (#3141)

mht-sharma committed 256 days ago

Verified 9c26b529

Preparing for release. (#3147)

Narsil committed 258 days ago

Verified d23b385e

Add llama4 (#3145)

mht-sharma committed 258 days ago

Verified d9bb9beb

Gaudi: Use exponential growth to replace BATCH_BUCKET_SIZE (#3131)

yuanwu2017 committed 261 days ago

Verified 3d059f91

nix-v3.2.1 -> v3.2.1-nix (#3129)

co42 committed 268 days ago

Verified 01425500

Gaudi: Fix llava-next and mllama crash issue (#3127)

yuanwu2017 committed 269 days ago

Verified f5f14dc6

Torch 2.6 (#3134)

Narsil committed 270 days ago

Verified 54d15462

CI: enable server tests for backends (#3128)

baptistecolle committed 274 days ago

Verified 2e60a8dd

configurable termination timeout (#3126)

ErikKaum committed 274 days ago

Verified e5503eba

Minor fixes. (#3125)

Narsil committed 276 days ago

Verified e497bc09

Intel docker. (#3121)

Narsil committed 276 days ago

Verified 67ce543e

Prepare for patch release. (#3124)

Narsil committed 276 days ago

Verified 83fe45c1

Publish nix docker image. (#3122)

Narsil committed 276 days ago

Verified 11f2eec1

Bug Fix: Sliding Window Attention (#3112)

mht-sharma committed 277 days ago

Verified a35fbdb9

Gaudi: Sync TGI with the latest changes from the TGI-Gaudi fork (#3117)

baptistecolle committed 277 days ago

Verified 8c2c348f

launcher: correctly get the head dimension for VLMs (#3116)

danieldk committed 277 days ago

Verified 095775e0

xpu 2.6 update (#3051)

sywangyi committed 277 days ago

Verified 0b3e3db0

Make the Nix-based Docker container work on non-NixOS (#3109)

danieldk committed 281 days ago

Verified f91434e9

Fixing the docker build. (#3108)

Narsil committed 281 days ago

Verified 8b91f929

Release of Gaudi Backend for TGI (#3091)

baptistecolle committed 281 days ago

Verified 27ed8486

We need gcc during runtime to enable triton to compile kernels. (#3103)

Narsil committed 282 days ago

Verified 83ef3641

Router: add `gemma3-text` model type (#3107)

danieldk committed 282 days ago

Verified 83b7b7bb

Older