huggingface/text-generation-inference

Pull Requests Commits

fix: re update the docs

drbh committed 1 year ago

48010f14

fix: run python update doc

drbh committed 1 year ago

b85c045b

fix: adjust types

drbh committed 1 year ago

abfc5810

Merge commit 'refs/pull/2076/head' of github.com:huggingface/text-generation-inference into main

drbh committed 1 year ago

75dccec4

feat: rotate tests ci token (#2091)

drbh committed 1 year ago

Verified cdbf8028

CI: pass pre-commit hooks again (#2084)

danieldk committed 1 year ago

Verified 11ea9ce0

CI: Tailscale improvements (#2079)

glegendre01 committed 1 year ago

Verified 4f25c67d

Set maximum grpc message receive size to 2GiB (#2075)

danieldk committed 1 year ago

Verified c8c7ccd3

Update Launcher Docs

KevinDuffy94 committed 1 year ago

cb8f999e

Update README.md

KevinDuffy94 committed 1 year ago

3c8fa90e

KevinDuffy94 committed 1 year ago

5673e5aa

Adding Service Name Environment variable for https://github.com/huggingface/text-generation-inference/issues/2069

KevinDuffy94 committed 1 year ago

6e93482c

fix build.rs watch files (#2072)

zirconium-n committed 1 year ago

Verified 0f7d38e7

Contributing guide & Code of Conduct (#2074)

LysandreJik committed 1 year ago

Verified 13183891

Support different image sizes in prefill in VLMs (#2065)

danieldk committed 1 year ago

Verified e9037708

Adding architecture document (#2044)

tengomucho committed 1 year ago

Verified 445f3135

Update the link for qwen2 (#2068)

xianbaoqian committed 1 year ago

Verified 96b7b40c

Add support for GPTQ Marlin (#2052)

danieldk committed 1 year ago

Verified 093a27c5

implement Open Inference Protocol endpoints (#1942)

drbh committed 1 year ago

Verified f433f1f7

PR #2049 CI run (#2054)

drbh committed 1 year ago

Verified 42aa8ee1

fix(layers): fix SuRotaryEmbedding (#2060)

OlivierDehaene committed 1 year ago

Verified 90184df7

fix(server): fix OPT implementation (#2061)

OlivierDehaene committed 1 year ago

Verified 521de6ca

Support chat response format (#2046)

drbh committed 1 year ago

Verified 376a0b7a

Update LLMM1 bound (#2050)

fxmarty committed 1 year ago

Verified a6e4d63c

fix(ci): remove unnecessary permissions (#2045)

McPatate committed 1 year ago

Verified dfca1dfc

feat(ci): add trufflehog secrets detection (#2038)

McPatate committed 1 year ago

Verified 4e74ec09

Add Phi-3 medium support (#2039)

danieldk committed 1 year ago

Verified 85dfc392

ROCm and sliding windows fixes (#2033)

fxmarty committed 1 year ago

Verified 9b3674d9

server: use chunked inputs

danieldk committed 1 year ago

bf3c8137

Xpu gqa (#2013)

sywangyi committed 1 year ago

Verified 4dabddb7

Older