huggingface/text-generation-inference

Pull Requests Commits

Revert "Update devcontainer to use correct update content command path"

mfuntowicz committed 1 year ago

9815feb2

Update devcontainer to use correct update content command path

mfuntowicz committed 1 year ago

b67073df

Update devcontainer to remove clang and base image on PyTorch

mfuntowicz committed 1 year ago

8e254287

Add devcontainer to ease backend development

mfuntowicz committed 1 year ago

f3e729a6

Missing dependency

mfuntowicz committed 1 year ago

91423771

First definition of binding trtllm to rust

mfuntowicz committed 1 year ago

4335a39f

enable build cmake binding

mfuntowicz committed 1 year ago

c6537df4

Adding build.rs to download and build TRTLLM c++ lib

mfuntowicz committed 1 year ago

e4ca7e96

Initial TRTLLM backend structure

mfuntowicz committed 1 year ago

da9456d0

OlivierDehaene committed 1 year ago

230f2a41

OlivierDehaene committed 1 year ago

93e0a7de

OlivierDehaene committed 1 year ago

b562680b

OlivierDehaene committed 1 year ago

50475486

fix: simplify kserve endpoint and fix imports (#2119)

drbh committed 1 year ago

Verified be2d3803

Add support for Marlin 2:4 sparsity (#2102)

danieldk committed 1 year ago

Verified f1f98e36

Support AWQ quantization with bias (#2117)

danieldk committed 1 year ago

Verified 14980df2

Enable multiple LoRa adapters (#2010)

drbh committed 1 year ago

Verified 04e1af94

Fix CI . (#2118)

Narsil committed 1 year ago

Verified a2a97b05

Add pytest release marker (#2114)

danieldk committed 1 year ago

Verified fc9c3153

fix cpu and xpu issue (#2116)

sywangyi committed 1 year ago

Verified e563983d

Removing IPEX_AVAIL. (#2115)

Narsil committed 1 year ago

Verified 9e2fdf57

feat: add simple tests for weights (#2092)

drbh committed 1 year ago

Verified 3f3b7ffd

Cpu tgi (#1936)

sywangyi committed 1 year ago

Verified b64c70c9

fix ChatCompletion and ChatCompletionChunk object string not compatible with standard openai api (#2089)

sunxichen committed 1 year ago

Verified b69f0780

use xpu-smi to dump used memory (#2047)

sywangyi committed 1 year ago

Verified 83634dc1

corrected Pydantic warning. (#2095)

yukiman76 committed 1 year ago

Verified 5b2155b0

Add OTLP Service Name Environment Variable (#2076)

KevinDuffy94 committed 1 year ago

Verified 1869ee2f

Support `HF_TOKEN` environment variable (#2066)

Wauplin committed 1 year ago

Verified 3447c722

Fix cargo-chef prepare (#2101)

ur4t committed 1 year ago

Verified 405765b1

New runner. Manual squash. (#2110)

Narsil committed 1 year ago

Verified 480d3b33

Older