huggingface/text-generation-inference

Pull Requests Commits

feat: lock updated kernel versions

drbh committed 1 year ago

70c616ca

Fixing the router + template for Qwen3. (#3200)

Narsil committed 1 year ago

Verified e7329fec

Put more wiggle room. (#3189)

Narsil committed 1 year ago

Verified 39cfe232

Warmup gaudi backend (#3172)

sywangyi committed 1 year ago

Verified 37580294

Add option to configure prometheus port (#3187)

mht-sharma committed 1 year ago

Verified 02715dc5

Fixing CI (#3184)

Narsil committed 1 year ago

Verified 8f881979

Bump `sccache` to 0.10.0 (#3179)

alvarobartt committed 1 year ago

Verified 95ccba37

Get opentelemetry trace id from request headers instead of creating a new trace (#2648)

kozistr committed 1 year ago

Verified b400c275

Support flashinfer for Gemma3 prefill (#3167)

danieldk committed 1 year ago

Verified 84ab88d8

Hotfix gaudi2 with newer transformers. (#3176)

Narsil committed 1 year ago

Verified 4645678f

Hotfixing gaudi deps. (#3174)

Narsil committed 1 year ago

Verified ad765cd0

Upgrading the dependencies in Gaudi backend. (#3170)

Narsil committed 1 year ago

Verified 16b4b797

transformers flash llm/vlm enabling in ipex (#3152)

sywangyi committed 1 year ago

Verified 459fbdeb

setuptools <= 70.0 is vulnerable: CVE-2024-6345 (#3171)

Narsil committed 1 year ago

Verified 449cee49

L4 fixes (#3161)

mht-sharma committed 1 year ago

Verified 73e79752

Upgrading the python client deps (still deprecated, but used for

Narsil committed 1 year ago

Verified fe56f760

Gaudi: clean cuda/rocm code in hpu backend, enable flat_hpu (#3113)

sywangyi committed 1 year ago

Verified d62c941c

Fixing tokenization like https://github.com/huggingface/text-embeddin… (#3156)

Narsil committed 1 year ago

Verified 9a8d0462

Fixing Qwen 2.5 VL (32B). (#3157)

Narsil committed 1 year ago

Verified 5861da1a

Narsil committed 1 year ago

Verified 0b28aabb

fix: compute type typo (#3150)

oOraph committed 1 year ago

Verified 24bec29f

Gaudi: Add Integration Test for Gaudi Backend (#3142)

baptistecolle committed 1 year ago

Verified 37104acd

Update transformers to 4.51 (#3148)

mht-sharma committed 1 year ago

Verified 87a0af4e

Use ROCM 6.3.1 (#3141)

mht-sharma committed 1 year ago

Verified 9c26b529

Preparing for release. (#3147)

Narsil committed 1 year ago

Verified d23b385e

Add llama4 (#3145)

mht-sharma committed 1 year ago

Verified d9bb9beb

Gaudi: Use exponential growth to replace BATCH_BUCKET_SIZE (#3131)

yuanwu2017 committed 1 year ago

Verified 3d059f91

nix-v3.2.1 -> v3.2.1-nix (#3129)

co42 committed 1 year ago

Verified 01425500

Gaudi: Fix llava-next and mllama crash issue (#3127)

yuanwu2017 committed 1 year ago

Verified f5f14dc6

Torch 2.6 (#3134)

Narsil committed 1 year ago

Verified 54d15462

Older