huggingface/text-generation-inference

Pull Requests Commits

danieldk committed 1 year ago

ff5ca67f

router: send the input as chunks to the backend

danieldk committed 1 year ago

ebeea9da

router: send the input as chunks to the backend

danieldk committed 1 year ago

fc52ba61

fix small typo and broken link (#1958)

MoritzLaurer committed 1 year ago

Verified b7ffa287

Processor config chat template (#1954)

drbh committed 1 year ago

Verified 0732b9d2

Fix GPTQ for models which do not have float16 at the default dtype (simpler) (#1953)

danieldk committed 1 year ago

Verified a401c83c

Fix (flash) Gemma prefix and enable tests

danieldk committed 1 year ago

9231098f

Fix seeded output. (#1949)

Narsil committed 1 year ago

Verified d32e33bd

Fixing codellama loads by using purely `AutoTokenizer`. (#1947)

Narsil committed 1 year ago

Verified cff472ba

Improving the logging system. (#1938)

Narsil committed 1 year ago

Verified 95465346

Add completion route to client and add stop parameter where it's missing (#1869)

thomas-schillaci committed 1 year ago

Verified 629047cb

Fixing some legacy behavior (big swapout of serverless on legacy stuff). (#1937)

Narsil committed 1 year ago

Verified f4a073ae

reenable xpu for tgi (#1939)

sywangyi committed 1 year ago

Verified f41d644a

feat: add train medusa head tutorial (#1934)

drbh committed 1 year ago

Verified a103e3e9

fix: use path inside of speculator config (#1935)

drbh committed 1 year ago

Verified efb73fcb

Creating doc automatically for supported models. (#1929)

Narsil committed 1 year ago

Verified 2f243a1a

feat: include token in client test like server tests (#1932)

drbh committed 1 year ago

Verified fc0eaffc

docs: Fix grafana dashboard url (#1925)

edwardzjl committed 1 year ago

Verified 904ff369

ROCm: make CK FA2 default instead of Triton (#1924)

fxmarty committed 1 year ago

Verified 293b8125

Fixing the download strategy for ibm-fms (#1917)

Narsil committed 1 year ago

Verified f871f114

Fix TGI issues with ROCm (#1921)

fxmarty committed 1 year ago

Verified 5dad0c0b

Fix TunableOp bug (#1920)

fxmarty committed 1 year ago

Verified b5f1c9de

Update grafana template (#1918)

fxmarty committed 1 year ago

Verified 422bf1f9

Add TGI monitoring guide through Grafana and Prometheus (#1908)

fxmarty committed 1 year ago

Verified c4cf8b49

MI300 compatibility (#1764)

fxmarty committed 1 year ago

Verified 232e8d52

Removing some unused code. (#1915)

Narsil committed 1 year ago

Verified a60fa840

Fixing signals. (#1910)

Narsil committed 1 year ago

Verified 3b5d93e6

Narsil committed 1 year ago

Verified b3dd3902

Fixing types. (#1906)

Narsil committed 1 year ago

Verified f5d43414

OpenAI function calling compatible support (#1888)

phangiabao98 committed 1 year ago

Verified d8402eaf

Older