huggingface/text-generation-inference

Pull Requests Commits

Adjust the `round_up_seq` logic in Gaudi backend (#3224)

kaixuanliu committed 220 days ago

Verified 535ce238

Change HPU warmup logic: seq length should be with exponential growth (#3217)

kaixuanliu committed 222 days ago

Verified c94f415a

Prepare for 3.3.0 (#3220)

danieldk committed 223 days ago

Verified 56c81894

Chunked Prefill VLM (#3188)

mht-sharma committed 226 days ago

Verified 329f612e

forward and tokenize chooser use the same shape (#3196)

sywangyi committed 226 days ago

Verified 533eee50

IPEX support FP8 kvcache/softcap/slidingwindow (#3144)

sywangyi committed 226 days ago

Verified 51a0b9d1

Fix `HF_HUB_OFFLINE=1` for Gaudi backend (#3193)

regisss committed 226 days ago

Verified f208ba6a

Update client SDK snippets (#3207)

julien-c committed 231 days ago

Verified 7253be34

fix: bump snaps for mllama (#3202)

drbh committed 231 days ago

Verified d303c1e3

Pr 2982 ci branch (#3046)

drbh committed 231 days ago

Verified 12ea8d74

doc typo (#3206)

julien-c committed 231 days ago

Verified 6afe4307

Skip `{% generation %}` and `{% endgeneration %}` template handling (#3204)

alvarobartt committed 231 days ago

Verified 40dfce64

Fixing the router + template for Qwen3. (#3200)

Narsil committed 233 days ago

Verified e7329fec

Put more wiggle room. (#3189)

Narsil committed 238 days ago

Verified 39cfe232

Warmup gaudi backend (#3172)

sywangyi committed 238 days ago

Verified 37580294

Add option to configure prometheus port (#3187)

mht-sharma committed 239 days ago

Verified 02715dc5

Fixing CI (#3184)

Narsil committed 244 days ago

Verified 8f881979

Bump `sccache` to 0.10.0 (#3179)

alvarobartt committed 244 days ago

Verified 95ccba37

Get opentelemetry trace id from request headers instead of creating a new trace (#2648)

kozistr committed 244 days ago

Verified b400c275

Support flashinfer for Gemma3 prefill (#3167)

danieldk committed 245 days ago

Verified 84ab88d8

Hotfix gaudi2 with newer transformers. (#3176)

Narsil committed 247 days ago

Verified 4645678f

Hotfixing gaudi deps. (#3174)

Narsil committed 247 days ago

Verified ad765cd0

Upgrading the dependencies in Gaudi backend. (#3170)

Narsil committed 247 days ago

Verified 16b4b797

transformers flash llm/vlm enabling in ipex (#3152)

sywangyi committed 247 days ago

Verified 459fbdeb

setuptools <= 70.0 is vulnerable: CVE-2024-6345 (#3171)

Narsil committed 247 days ago

Verified 449cee49

L4 fixes (#3161)

mht-sharma committed 248 days ago

Verified 73e79752

Upgrading the python client deps (still deprecated, but used for

Narsil committed 248 days ago

Verified fe56f760

Gaudi: clean cuda/rocm code in hpu backend, enable flat_hpu (#3113)

sywangyi committed 248 days ago

Verified d62c941c

Fixing tokenization like https://github.com/huggingface/text-embeddin… (#3156)

Narsil committed 253 days ago

Verified 9a8d0462

Fixing Qwen 2.5 VL (32B). (#3157)

Narsil committed 253 days ago

Verified 5861da1a

Newer Older