huggingface/text-generation-inference

Pull Requests Commits

Add the missing `tool_prompt` to Python client

maziyarpanahi committed 1 year ago

1f30217a

Better graceful shutdown. (#1827)

Narsil committed 1 year ago

Verified eade7377

Changing the waiting_served_ratio default (stack more aggressively by default). (#1820)

Narsil committed 1 year ago

Verified 007d5e54

Dummy CI run. (#1817)

Narsil committed 1 year ago

Verified e9f03f82

Fixing qwen2. (#1818)

Narsil committed 1 year ago

Verified 8b8e8f66

Blunder (#1815)

Narsil committed 1 year ago

Verified a8fd4236

add intel xpu support for TGI (#1475)

sywangyi committed 1 year ago

Verified 45ecf9d0

Adding new env variables for TPU backends. (#1755)

Narsil committed 1 year ago

Verified f9cf3456

2nd round of benchmark modifications (tiny adjustements to avoid overloading the host). (#1816)

Narsil committed 1 year ago

Verified bbc547ad

Use the generation config. (#1808)

Narsil committed 1 year ago

Verified ee47973a

Update guidance docs to reflect grammar support in API (#1775)

dr3s committed 1 year ago

Verified eb08b9fa

Updating the benchmarks so everyone uses openai compat layer. (#1800)

Narsil committed 1 year ago

Verified fccf5edf

feat: improve temperature logic in chat (#1749)

drbh committed 1 year ago

Verified 0acac5cb

Adding support for `HF_HUB_OFFLINE` support in the router. (#1789)

Narsil committed 1 year ago

Verified 4c698fa6

fix: avoid frequency and repetition penalty on padding tokens (#1765)

drbh committed 1 year ago

Verified 23d82b8f

Idefics2. (#1756)

Narsil committed 1 year ago

Verified bfddfa59

Phi3 support (#1797)

Narsil committed 1 year ago

Verified 986b4044

feat: allow null eos and bos tokens in config (#1791)

drbh committed 1 year ago

Verified 9be1db31

Add attribute descriptions for `GenerateParameters` (#1798)

Wauplin committed 1 year ago

Verified 455cada5

fix typos in docs and add small clarifications (#1790)

MoritzLaurer committed 1 year ago

Verified ed72e921

Make `--cuda-graphs` work as expected (bis) (#1768)

fxmarty committed 1 year ago

Verified 26b39166

OlivierDehaene committed 1 year ago

2d0a7173

Upgrading all versions. (#1759)

Narsil committed 1 year ago

Verified f9ee2c41

feat: accept list as prompt and use first string (#1702)

drbh committed 1 year ago

Verified 06c3d4b1

fix: bump clients test base url to llama (#1751)

drbh committed 1 year ago

Verified e4d31a40

Update response type for `/v1/chat/completions` and `/v1/completions` (#1747)

Wauplin committed 1 year ago

Verified 00f36535

feat: improve tools to include name and add tests (#1693)

drbh committed 1 year ago

Verified 7276d434

Fixing CI. (#1748)

Narsil committed 1 year ago

Verified 88702d87

OlivierDehaene committed 1 year ago

Verified c38a7d7d

Fix typo in guidance.md (#1735)

eltociear committed 1 year ago

Verified 275caa04

Older