huggingface/text-generation-inference

Pull Requests Commits

Removing IPEX_AVAIL. (#2115)

Narsil committed 1 year ago

Verified 9e2fdf57

feat: add simple tests for weights (#2092)

drbh committed 1 year ago

Verified 3f3b7ffd

Cpu tgi (#1936)

sywangyi committed 1 year ago

Verified b64c70c9

fix ChatCompletion and ChatCompletionChunk object string not compatible with standard openai api (#2089)

sunxichen committed 1 year ago

Verified b69f0780

use xpu-smi to dump used memory (#2047)

sywangyi committed 1 year ago

Verified 83634dc1

corrected Pydantic warning. (#2095)

yukiman76 committed 1 year ago

Verified 5b2155b0

Add OTLP Service Name Environment Variable (#2076)

KevinDuffy94 committed 1 year ago

Verified 1869ee2f

Support `HF_TOKEN` environment variable (#2066)

Wauplin committed 1 year ago

Verified 3447c722

Fix cargo-chef prepare (#2101)

ur4t committed 1 year ago

Verified 405765b1

New runner. Manual squash. (#2110)

Narsil committed 1 year ago

Verified 480d3b33

feat: sort cuda graphs in descending order (#2104)

drbh committed 1 year ago

Verified 811a9381

Fix `text-generation-server quantize` (#2103)

danieldk committed 1 year ago

Verified 197c47a3

Factor out sharding of packed tensors (#2059)

danieldk committed 1 year ago

Verified bcb3faa1

Support exl2-quantized Qwen2 models (#2085)

danieldk committed 1 year ago

Verified f5a98375

feat: rotate tests ci token (#2091)

drbh committed 1 year ago

Verified cdbf8028

CI: pass pre-commit hooks again (#2084)

danieldk committed 1 year ago

Verified 11ea9ce0

CI: Tailscale improvements (#2079)

glegendre01 committed 1 year ago

Verified 4f25c67d

Set maximum grpc message receive size to 2GiB (#2075)

danieldk committed 1 year ago

Verified c8c7ccd3

fix build.rs watch files (#2072)

zirconium-n committed 1 year ago

Verified 0f7d38e7

Contributing guide & Code of Conduct (#2074)

LysandreJik committed 1 year ago

Verified 13183891

Support different image sizes in prefill in VLMs (#2065)

danieldk committed 1 year ago

Verified e9037708

Adding architecture document (#2044)

tengomucho committed 1 year ago

Verified 445f3135

Update the link for qwen2 (#2068)

xianbaoqian committed 1 year ago

Verified 96b7b40c

Add support for GPTQ Marlin (#2052)

danieldk committed 1 year ago

Verified 093a27c5

implement Open Inference Protocol endpoints (#1942)

drbh committed 1 year ago

Verified f433f1f7

PR #2049 CI run (#2054)

drbh committed 1 year ago

Verified 42aa8ee1

fix(layers): fix SuRotaryEmbedding (#2060)

OlivierDehaene committed 1 year ago

Verified 90184df7

fix(server): fix OPT implementation (#2061)

OlivierDehaene committed 1 year ago

Verified 521de6ca

Support chat response format (#2046)

drbh committed 1 year ago

Verified 376a0b7a

Update LLMM1 bound (#2050)

fxmarty committed 1 year ago

Verified a6e4d63c

Newer Older