huggingface/text-generation-inference

Pull Requests Commits

drbh committed 280 days ago

551ee3a3

fix: prefer patch to be vlm specific

drbh committed 280 days ago

783ca669

fix: read vocab size from tokenizer and add hacky patch for qwen2b

drbh committed 280 days ago

b32cd97b

fix: remove the bias padding

drbh committed 280 days ago

55d82d46

fix: improve validation and transform logic

drbh committed 280 days ago

7659925d

fix: avoid zero'd logit bias mask

drbh committed 280 days ago

465294d3

fix: cleanup typos

drbh committed 280 days ago

b3ead6e9

fix: improve processor logic and refactor

drbh committed 280 days ago

9eeccbf9

fix: remove deprecated test and fix typing

drbh committed 280 days ago

bb5c875f

fix: adjust imports

drbh committed 280 days ago

81656bd0

fix: include logit_bias in all ValidGenerateRequest's

drbh committed 280 days ago

61a50a81

fix: adjust the NextTokenChooser logit bias processor

drbh committed 280 days ago

e44703d5

feat: include proto changes

drbh committed 280 days ago

da3f18e5

feat: support logit bias in chat request

drbh committed 280 days ago

fae510b8

Update client SDK snippets (#3207)

julien-c committed 284 days ago

Verified 7253be34

fix: bump snaps for mllama (#3202)

drbh committed 284 days ago

Verified d303c1e3

Pr 2982 ci branch (#3046)

drbh committed 284 days ago

Verified 12ea8d74

doc typo (#3206)

julien-c committed 284 days ago

Verified 6afe4307

Skip `{% generation %}` and `{% endgeneration %}` template handling (#3204)

alvarobartt committed 285 days ago

Verified 40dfce64

Fixing the router + template for Qwen3. (#3200)

Narsil committed 286 days ago

Verified e7329fec

Put more wiggle room. (#3189)

Narsil committed 291 days ago

Verified 39cfe232

Warmup gaudi backend (#3172)

sywangyi committed 292 days ago

Verified 37580294

Add option to configure prometheus port (#3187)

mht-sharma committed 292 days ago

Verified 02715dc5

Fixing CI (#3184)

Narsil committed 297 days ago

Verified 8f881979

Bump `sccache` to 0.10.0 (#3179)

alvarobartt committed 297 days ago

Verified 95ccba37

Get opentelemetry trace id from request headers instead of creating a new trace (#2648)

kozistr committed 298 days ago

Verified b400c275

Support flashinfer for Gemma3 prefill (#3167)

danieldk committed 298 days ago

Verified 84ab88d8

Hotfix gaudi2 with newer transformers. (#3176)

Narsil committed 300 days ago

Verified 4645678f

Hotfixing gaudi deps. (#3174)

Narsil committed 301 days ago

Verified ad765cd0

Upgrading the dependencies in Gaudi backend. (#3170)

Narsil committed 301 days ago

Verified 16b4b797

Older