huggingface/text-generation-inference

Pull Requests Commits

Removing accepted ids in the regular info logs, downgrade to debug. (#1898)

Narsil committed 1 year ago

Verified a70b087e

Add GPT-2 with flash attention (#1889)

Daniël de Kok committed 1 year ago

Verified b5bc6e5c

Correct 'using guidance' link (#1892)

brandon-lockaby committed 1 year ago

Verified 92f1338b

Fixing truncation. (#1890)

Narsil committed 1 year ago

Verified 33bc7212

MLPSpeculator. (#1865)

Narsil committed 1 year ago

Verified e3d76564

Add: Support for the Falcon2 11B architecture (#1886)

Nilabhra committed 1 year ago

Verified 3136f27f

Granite support? (#1882)

Narsil committed 1 year ago

Verified d348d2b2

Refactor layers. (#1866)

Narsil committed 1 year ago

Verified fd89d9df

update xpu docker image and use public ipex whel (#1860)

sywangyi committed 1 year ago

Verified 59b3ffea

Upgrading to rust 1.78. (#1851)

Narsil committed 1 year ago

Verified ac7076b6

Add router name to /info endpoint (#1854)

Wauplin committed 1 year ago

Verified bb2b2959

Updating Phi3 (long context). (#1849)

Narsil committed 1 year ago

Verified a2573713

feat: prefer huggingface_hub in docs and show image api (#1844)

drbh committed 1 year ago

Verified 65539b74

Remove misleading warning (not that important nowadays anyway). (#1848)

Narsil committed 1 year ago

Verified de079d60

Adding scripts to prepare load data. (#1841)

Narsil committed 1 year ago

Verified 0038e602

Fix: "Fixing" double BOS for mistral too. (#1843)

Narsil committed 1 year ago

Verified 27b3a2c9

fix: split docs and start conceptual page (#1836)

drbh committed 1 year ago

Verified 6073ece4

(chore): torch 2.3.0 (#1833)

Narsil committed 1 year ago

Verified dccab725

chore: update torch (#1730)

OlivierDehaene committed 1 year ago

Verified b4ef0388

Handle images in chat api (#1828)

drbh committed 1 year ago

Verified c99ecd77

feat: add vlm docs and simple examples (#1812)

drbh committed 1 year ago

Verified b2c98275

Fixing frequency penalty (#1811)

martinigoyanes committed 1 year ago

Verified 9192de57

feat: add how it works section (#1773)

drbh committed 1 year ago

Verified f6615080

fix: use get_speculate to the number of layers (#1737)

OlivierDehaene committed 1 year ago

Verified 8332fc49

Add reference to TPU support (#1760)

brandonroyal committed 1 year ago

Verified 743ecbca

Small CI cleanup. (#1801)

Narsil committed 1 year ago

Verified 04d4765b

Add the missing `tool_prompt` parameter to Python client (#1825)

maziyarpanahi committed 1 year ago

Verified 51ee60da

Prepare release.

Narsil committed 1 year ago

f75c1a5b

Better graceful shutdown. (#1827)

Narsil committed 1 year ago

Verified eade7377

Changing the waiting_served_ratio default (stack more aggressively by default). (#1820)

Narsil committed 1 year ago

Verified 007d5e54

Newer Older