huggingface/text-generation-inference

Pull Requests Commits

Update Gradio ChatInterface configuration in consuming_tgi.md (#3042)

angt committed 1 year ago

Verified 3498f608

Simplify logs2. (#3045)

Narsil committed 1 year ago

Verified 142a49a8

fix qwen2 vl crash in continous batching (#3004)

sywangyi committed 1 year ago

Verified 06dfe9ab

flashinfer 0.2.0.post1 -> post2 (#3040)

danieldk committed 1 year ago

Verified ed96ba65

update ipex and torch to 2.6 for cpu (#3039)

sywangyi committed 1 year ago

Verified feaa2477

feat: Add the parsing of HF_HUB_USER_AGENT_ORIGIN environment variable for telemetry (#3027)

Hugoch committed 1 year ago

Verified 230aa256

Having less logs in case of failure for checking CI more easily. (#3037)

Narsil committed 1 year ago

Verified 9c89d007

Using public external registry (to use external runners for CI). (#3031)

Narsil committed 1 year ago

Verified fde3234c

feat: add initial qwen2.5-vl model and test (#2971)

drbh committed 1 year ago

Verified d6a0c67e

Improve Transformers support (#2970)

Cyrilvallez committed 1 year ago

Verified a7448661

It's find in some machine. using hf_hub::api::sync::Api to download c… (#3030)

Narsil committed 1 year ago

Verified 5543fdc7

Pinning trufflehog. (#3032)

Narsil committed 1 year ago

Verified b8a4928d

Add `loop_controls` feature to `minijinja` to handle `{% break %}` (#2998)

alvarobartt committed 1 year ago

Verified 8a1cfd61

Update README.md (#3024)

celsowm committed 1 year ago

Verified 794ec58b

Use eetq kernel from the hub (#3029)

danieldk committed 1 year ago

Verified f0ed7658

[Backend] Add Llamacpp backend (#2975)

angt committed 1 year ago

Verified cfd4fbb4

Support sigmoid scoring function in GPTQ-MoE (#3017)

danieldk committed 1 year ago

Verified 6df0fc0b

Putting back the NCCL forced upgrade. (#2999)

Narsil committed 1 year ago

Verified d6881c37

Preventing single user hugging the server to death by asking (#3016)

Narsil committed 1 year ago

Verified 8a211dc7

Update the flaky mllama test. (#3015)

Narsil committed 1 year ago

Verified 4cccce4b

fix Qwen VL break in intel platform (#3002)

sywangyi committed 1 year ago

Verified 76bcb494

Revert "Update the flaky mllama test."

Narsil committed 1 year ago

Verified b86c3947

Update the flaky mllama test.

Narsil committed 1 year ago

Verified 8a870b31

Use kernels from the kernel hub (#2988)

danieldk committed 1 year ago

Verified 571ac9b5

Updating mllama after strftime. (#2993)

Narsil committed 1 year ago

Verified 4b8cda68

[Backend] Bump TRTLLM to v.0.17.0 (#2991)

mfuntowicz committed 1 year ago

Verified 856709d5

Triton fix (#2995)

sywangyi committed 1 year ago

Verified 36223f83

Using the "lockfile". (#2992)

Narsil committed 1 year ago

Verified 0ef8c8a9

Improve qwen vl impl (#2943)

drbh committed 1 year ago

Verified c1cf36c0

impureWithCuda: fix gcc version (#2990)

danieldk committed 1 year ago

Verified dd2bd5fd

Newer Older