huggingface/text-generation-inference

Pull Requests Commits

fxmarty committed 1 year ago

cd3c28cf

Update grafana template (#1918)

fxmarty committed 1 year ago

Verified 422bf1f9

Add TGI monitoring guide through Grafana and Prometheus (#1908)

fxmarty committed 1 year ago

Verified c4cf8b49

MI300 compatibility (#1764)

fxmarty committed 1 year ago

Verified 232e8d52

Removing some unused code. (#1915)

Narsil committed 1 year ago

Verified a60fa840

Fixing signals. (#1910)

Narsil committed 1 year ago

Verified 3b5d93e6

Narsil committed 1 year ago

Verified b3dd3902

Fixing types. (#1906)

Narsil committed 1 year ago

Verified f5d43414

OpenAI function calling compatible support (#1888)

phangiabao98 committed 1 year ago

Verified d8402eaf

Pali gemma modeling (#1895)

drbh committed 1 year ago

Verified 40213c95

[Bug Fix] Update torch import reference in bnb quantization (#1902)

DhruvSrikanth committed 1 year ago

Verified 6c715f81

feat: add deprecation warning to clients (#1855)

drbh committed 1 year ago

Verified a69ef52c

Removing accepted ids in the regular info logs, downgrade to debug. (#1898)

Narsil committed 1 year ago

Verified a70b087e

Add GPT-2 with flash attention (#1889)

Daniël de Kok committed 1 year ago

Verified b5bc6e5c

Correct 'using guidance' link (#1892)

brandon-lockaby committed 1 year ago

Verified 92f1338b

Fixing truncation. (#1890)

Narsil committed 1 year ago

Verified 33bc7212

MLPSpeculator. (#1865)

Narsil committed 1 year ago

Verified e3d76564

Add: Support for the Falcon2 11B architecture (#1886)

Nilabhra committed 1 year ago

Verified 3136f27f

Granite support? (#1882)

Narsil committed 1 year ago

Verified d348d2b2

Refactor layers. (#1866)

Narsil committed 1 year ago

Verified fd89d9df

update xpu docker image and use public ipex whel (#1860)

sywangyi committed 1 year ago

Verified 59b3ffea

Upgrading to rust 1.78. (#1851)

Narsil committed 1 year ago

Verified ac7076b6

Add router name to /info endpoint (#1854)

Wauplin committed 1 year ago

Verified bb2b2959

Updating Phi3 (long context). (#1849)

Narsil committed 1 year ago

Verified a2573713

feat: prefer huggingface_hub in docs and show image api (#1844)

drbh committed 1 year ago

Verified 65539b74

Remove misleading warning (not that important nowadays anyway). (#1848)

Narsil committed 1 year ago

Verified de079d60

Adding scripts to prepare load data. (#1841)

Narsil committed 1 year ago

Verified 0038e602

Fix: "Fixing" double BOS for mistral too. (#1843)

Narsil committed 1 year ago

Verified 27b3a2c9

fix: split docs and start conceptual page (#1836)

drbh committed 1 year ago

Verified 6073ece4

(chore): torch 2.3.0 (#1833)

Narsil committed 1 year ago

Verified dccab725

Older