huggingface/text-generation-inference

Pull Requests Commits

OlivierDehaene committed 2 years ago

fe9abad1

OlivierDehaene committed 2 years ago

e5c27364

OlivierDehaene committed 2 years ago

b21ed583

Merge branch 'main' into feat/page_re_alloc

OlivierDehaene committed 2 years ago

Verified fe6a2756

added padded blocks and logs everywhere

OlivierDehaene committed 2 years ago

7ed10445

CI: pass pre-commit hooks again (#2084)

danieldk committed 2 years ago

Verified 11ea9ce0

CI: Tailscale improvements (#2079)

glegendre01 committed 2 years ago

Verified 4f25c67d

Set maximum grpc message receive size to 2GiB (#2075)

danieldk committed 2 years ago

Verified c8c7ccd3

fix build.rs watch files (#2072)

zirconium-n committed 2 years ago

Verified 0f7d38e7

Contributing guide & Code of Conduct (#2074)

LysandreJik committed 2 years ago

Verified 13183891

Support different image sizes in prefill in VLMs (#2065)

danieldk committed 2 years ago

Verified e9037708

Adding architecture document (#2044)

tengomucho committed 2 years ago

Verified 445f3135

Update the link for qwen2 (#2068)

xianbaoqian committed 2 years ago

Verified 96b7b40c

Add support for GPTQ Marlin (#2052)

danieldk committed 2 years ago

Verified 093a27c5

implement Open Inference Protocol endpoints (#1942)

drbh committed 2 years ago

Verified f433f1f7

PR #2049 CI run (#2054)

drbh committed 2 years ago

Verified 42aa8ee1

OlivierDehaene committed 2 years ago

abe52120

allocate 16 by 16

OlivierDehaene committed 2 years ago

05eb4dcb

fix(layers): fix SuRotaryEmbedding (#2060)

OlivierDehaene committed 2 years ago

Verified 90184df7

fix(server): fix OPT implementation (#2061)

OlivierDehaene committed 2 years ago

Verified 521de6ca

remove slots from grpc

OlivierDehaene committed 2 years ago

9ac7b7bc

OlivierDehaene committed 2 years ago

c2fb459b

fix rust and python unit-tests

OlivierDehaene committed 2 years ago

37266e2d

Support chat response format (#2046)

drbh committed 2 years ago

Verified 376a0b7a

Update LLMM1 bound (#2050)

fxmarty committed 2 years ago

Verified a6e4d63c

FlashCausalLM implem

OlivierDehaene committed 2 years ago

73c39032

OlivierDehaene committed 2 years ago

6983ec95

re-working logic, wip

OlivierDehaene committed 2 years ago

713d70b4

add terminated_generations

OlivierDehaene committed 2 years ago

298bf31e

fix python tests

OlivierDehaene committed 2 years ago

3c596983

Older