huggingface/text-generation-inference

Pull Requests Commits
Support flashinfer for Gemma3 prefill (#3167)
danieldk committed 313 days ago
Verified 84ab88d8
Hotfix gaudi2 with newer transformers. (#3176)
Narsil committed 315 days ago
Verified 4645678f
Hotfixing gaudi deps. (#3174)
Narsil committed 315 days ago
Verified ad765cd0
Upgrading the dependencies in Gaudi backend. (#3170)
Narsil committed 315 days ago
Verified 16b4b797
transformers flash llm/vlm enabling in ipex (#3152)
sywangyi committed 315 days ago
Verified 459fbdeb
setuptools <= 70.0 is vulnerable: CVE-2024-6345 (#3171)
Narsil committed 315 days ago
Verified 449cee49
L4 fixes (#3161)
mht-sharma committed 316 days ago
Verified 73e79752
Upgrading the python client deps (still deprecated, but used for
Narsil committed 316 days ago
Verified fe56f760
Gaudi: clean cuda/rocm code in hpu backend, enable flat_hpu (#3113)
sywangyi committed 316 days ago
Verified d62c941c
Fixing tokenization like https://github.com/huggingface/text-embeddin… (#3156)
Narsil committed 321 days ago
Verified 9a8d0462
Fixing Qwen 2.5 VL (32B). (#3157)
Narsil committed 321 days ago
Verified 5861da1a
3.2.3 (#3151)
Narsil committed 322 days ago
Verified 0b28aabb
fix: compute type typo (#3150)
oOraph committed 323 days ago
Verified 24bec29f
Gaudi: Add Integration Test for Gaudi Backend (#3142)
baptistecolle committed 323 days ago
Verified 37104acd
Update transformers to 4.51 (#3148)
mht-sharma committed 323 days ago
Verified 87a0af4e
Use ROCM 6.3.1 (#3141)
mht-sharma committed 323 days ago
Verified 9c26b529
Preparing for release. (#3147)
Narsil committed 324 days ago
Verified d23b385e
Add llama4 (#3145)
mht-sharma committed 324 days ago
Verified d9bb9beb
Gaudi: Use exponential growth to replace BATCH_BUCKET_SIZE (#3131)
yuanwu2017 committed 327 days ago
Verified 3d059f91
nix-v3.2.1 -> v3.2.1-nix (#3129)
co42 committed 335 days ago
Verified 01425500
Gaudi: Fix llava-next and mllama crash issue (#3127)
yuanwu2017 committed 336 days ago
Verified f5f14dc6
Torch 2.6 (#3134)
Narsil committed 337 days ago
Verified 54d15462
CI: enable server tests for backends (#3128)
baptistecolle committed 341 days ago
Verified 2e60a8dd
configurable termination timeout (#3126)
ErikKaum committed 341 days ago
Verified e5503eba
Minor fixes. (#3125)
Narsil committed 343 days ago
Verified e497bc09
Intel docker. (#3121)
Narsil committed 343 days ago
Verified 67ce543e
Prepare for patch release. (#3124)
Narsil committed 343 days ago
Verified 83fe45c1
Publish nix docker image. (#3122)
Narsil committed 343 days ago
Verified 11f2eec1
Bug Fix: Sliding Window Attention (#3112)
mht-sharma committed 343 days ago
Verified a35fbdb9
Gaudi: Sync TGI with the latest changes from the TGI-Gaudi fork (#3117)
baptistecolle committed 343 days ago
Verified 8c2c348f
Terms Of Use Privacy Policy Refund Policy Impressum