huggingface/text-generation-inference

Pull Requests Commits

fix: bump huggingface_hub version

drbh committed 1 year ago

887ffe7e

feat: improve serde add tests and cleanup

drbh committed 1 year ago

f8be8d5d

feat: improve message content chunks handling

drbh committed 1 year ago

c98a6b99

Fix: "Fixing" double BOS for mistral too. (#1843)

Narsil committed 1 year ago

Verified 27b3a2c9

fix: split docs and start conceptual page (#1836)

drbh committed 1 year ago

Verified 6073ece4

(chore): torch 2.3.0 (#1833)

Narsil committed 1 year ago

Verified dccab725

chore: update torch (#1730)

OlivierDehaene committed 1 year ago

Verified b4ef0388

Handle images in chat api (#1828)

drbh committed 1 year ago

Verified c99ecd77

feat: add vlm docs and simple examples (#1812)

drbh committed 1 year ago

Verified b2c98275

Fixing frequency penalty (#1811)

martinigoyanes committed 1 year ago

Verified 9192de57

feat: add how it works section (#1773)

drbh committed 1 year ago

Verified f6615080

fix: use get_speculate to the number of layers (#1737)

OlivierDehaene committed 1 year ago

Verified 8332fc49

Add reference to TPU support (#1760)

brandonroyal committed 1 year ago

Verified 743ecbca

Small CI cleanup. (#1801)

Narsil committed 1 year ago

Verified 04d4765b

Add the missing `tool_prompt` parameter to Python client (#1825)

maziyarpanahi committed 1 year ago

Verified 51ee60da

Prepare release.

Narsil committed 1 year ago

f75c1a5b

Better graceful shutdown. (#1827)

Narsil committed 1 year ago

Verified eade7377

Changing the waiting_served_ratio default (stack more aggressively by default). (#1820)

Narsil committed 1 year ago

Verified 007d5e54

Dummy CI run. (#1817)

Narsil committed 1 year ago

Verified e9f03f82

Fixing qwen2. (#1818)

Narsil committed 1 year ago

Verified 8b8e8f66

Blunder (#1815)

Narsil committed 1 year ago

Verified a8fd4236

add intel xpu support for TGI (#1475)

sywangyi committed 1 year ago

Verified 45ecf9d0

Adding new env variables for TPU backends. (#1755)

Narsil committed 1 year ago

Verified f9cf3456

2nd round of benchmark modifications (tiny adjustements to avoid overloading the host). (#1816)

Narsil committed 1 year ago

Verified bbc547ad

Use the generation config. (#1808)

Narsil committed 1 year ago

Verified ee47973a

Update guidance docs to reflect grammar support in API (#1775)

dr3s committed 1 year ago

Verified eb08b9fa

Updating the benchmarks so everyone uses openai compat layer. (#1800)

Narsil committed 1 year ago

Verified fccf5edf

feat: improve temperature logic in chat (#1749)

drbh committed 1 year ago

Verified 0acac5cb

Adding support for `HF_HUB_OFFLINE` support in the router. (#1789)

Narsil committed 1 year ago

Verified 4c698fa6

fix: avoid frequency and repetition penalty on padding tokens (#1765)

drbh committed 1 year ago

Verified 23d82b8f

Older