huggingface/text-generation-inference

Pull Requests Commits
MLPSpeculator. (#1865)
Narsil committed 1 year ago
Verified e3d76564
Add: Support for the Falcon2 11B architecture (#1886)
Nilabhra committed 1 year ago
Verified 3136f27f
Granite support? (#1882)
Narsil committed 1 year ago
Verified d348d2b2
Refactor layers. (#1866)
Narsil committed 1 year ago
Verified fd89d9df
update xpu docker image and use public ipex whel (#1860)
sywangyi committed 1 year ago
Verified 59b3ffea
Upgrading to rust 1.78. (#1851)
Narsil committed 1 year ago
Verified ac7076b6
Add router name to /info endpoint (#1854)
Wauplin committed 1 year ago
Verified bb2b2959
Updating Phi3 (long context). (#1849)
Narsil committed 1 year ago
Verified a2573713
feat: prefer huggingface_hub in docs and show image api (#1844)
drbh committed 1 year ago
Verified 65539b74
Remove misleading warning (not that important nowadays anyway). (#1848)
Narsil committed 1 year ago
Verified de079d60
Adding scripts to prepare load data. (#1841)
Narsil committed 1 year ago
Verified 0038e602
Fix: "Fixing" double BOS for mistral too. (#1843)
Narsil committed 1 year ago
Verified 27b3a2c9
fix: split docs and start conceptual page (#1836)
drbh committed 1 year ago
Verified 6073ece4
(chore): torch 2.3.0 (#1833)
Narsil committed 1 year ago
Verified dccab725
chore: update torch (#1730)
OlivierDehaene committed 1 year ago
Verified b4ef0388
Handle images in chat api (#1828)
drbh committed 1 year ago
Verified c99ecd77
feat: add vlm docs and simple examples (#1812)
drbh committed 1 year ago
Verified b2c98275
Fixing frequency penalty (#1811)
martinigoyanes committed 1 year ago
Verified 9192de57
feat: add how it works section (#1773)
drbh committed 1 year ago
Verified f6615080
fix: use get_speculate to the number of layers (#1737)
OlivierDehaene committed 1 year ago
Verified 8332fc49
Add reference to TPU support (#1760)
brandonroyal committed 1 year ago
Verified 743ecbca
Small CI cleanup. (#1801)
Narsil committed 1 year ago
Verified 04d4765b
Add the missing `tool_prompt` parameter to Python client (#1825)
maziyarpanahi committed 1 year ago
Verified 51ee60da
Prepare release.
Narsil committed 1 year ago
f75c1a5b
Better graceful shutdown. (#1827)
Narsil committed 1 year ago
Verified eade7377
Changing the waiting_served_ratio default (stack more aggressively by default). (#1820)
Narsil committed 1 year ago
Verified 007d5e54
Dummy CI run. (#1817)
Narsil committed 1 year ago
Verified e9f03f82
Fixing qwen2. (#1818)
Narsil committed 1 year ago
Verified 8b8e8f66
Blunder (#1815)
Narsil committed 1 year ago
Verified a8fd4236
add intel xpu support for TGI (#1475)
sywangyi committed 1 year ago
Verified 45ecf9d0
Terms Of Use Privacy Policy Refund Policy Impressum