huggingface/text-generation-inference

Pull Requests Commits

Flashinfer test.

Narsil committed 1 year ago

3c74cf9c

REvert changes in modeling.

Narsil committed 1 year ago

01e4442e

Less intrusive.

Narsil committed 1 year ago

63e72033

Fix after rebase..

Narsil committed 1 year ago

cacba5f2

Using flash decoding

Narsil committed 1 year ago

1b86d0f3

Fixing codellama loads by using purely `AutoTokenizer`. (#1947)

Narsil committed 1 year ago

Verified cff472ba

Improving the logging system. (#1938)

Narsil committed 1 year ago

Verified 95465346

Add completion route to client and add stop parameter where it's missing (#1869)

thomas-schillaci committed 1 year ago

Verified 629047cb

Fixing some legacy behavior (big swapout of serverless on legacy stuff). (#1937)

Narsil committed 1 year ago

Verified f4a073ae

reenable xpu for tgi (#1939)

sywangyi committed 1 year ago

Verified f41d644a

feat: add train medusa head tutorial (#1934)

drbh committed 1 year ago

Verified a103e3e9

fix: use path inside of speculator config (#1935)

drbh committed 1 year ago

Verified efb73fcb

Creating doc automatically for supported models. (#1929)

Narsil committed 1 year ago

Verified 2f243a1a

feat: include token in client test like server tests (#1932)

drbh committed 1 year ago

Verified fc0eaffc

docs: Fix grafana dashboard url (#1925)

edwardzjl committed 1 year ago

Verified 904ff369

ROCm: make CK FA2 default instead of Triton (#1924)

fxmarty committed 1 year ago

Verified 293b8125

Fixing the download strategy for ibm-fms (#1917)

Narsil committed 1 year ago

Verified f871f114

Fix TGI issues with ROCm (#1921)

fxmarty committed 1 year ago

Verified 5dad0c0b

Fix TunableOp bug (#1920)

fxmarty committed 1 year ago

Verified b5f1c9de

Update grafana template (#1918)

fxmarty committed 1 year ago

Verified 422bf1f9

Add TGI monitoring guide through Grafana and Prometheus (#1908)

fxmarty committed 1 year ago

Verified c4cf8b49

MI300 compatibility (#1764)

fxmarty committed 1 year ago

Verified 232e8d52

Removing some unused code. (#1915)

Narsil committed 1 year ago

Verified a60fa840

Fixing signals. (#1910)

Narsil committed 1 year ago

Verified 3b5d93e6

Narsil committed 1 year ago

Verified b3dd3902

Fixing types. (#1906)

Narsil committed 1 year ago

Verified f5d43414

OpenAI function calling compatible support (#1888)

phangiabao98 committed 1 year ago

Verified d8402eaf

Pali gemma modeling (#1895)

drbh committed 1 year ago

Verified 40213c95

[Bug Fix] Update torch import reference in bnb quantization (#1902)

DhruvSrikanth committed 1 year ago

Verified 6c715f81

feat: add deprecation warning to clients (#1855)

drbh committed 1 year ago

Verified a69ef52c

Older