huggingface/text-generation-inference

Pull Requests Commits
mirror docker
OlivierDehaene committed 1 year ago
fe9abad1
avoid join_all
OlivierDehaene committed 1 year ago
e5c27364
fix logic
OlivierDehaene committed 1 year ago
b21ed583
Merge branch 'main' into feat/page_re_alloc
OlivierDehaene committed 1 year ago
Verified fe6a2756
added padded blocks and logs everywhere
OlivierDehaene committed 1 year ago
7ed10445
CI: pass pre-commit hooks again (#2084)
danieldk committed 1 year ago
Verified 11ea9ce0
CI: Tailscale improvements (#2079)
glegendre01 committed 1 year ago
Verified 4f25c67d
Set maximum grpc message receive size to 2GiB (#2075)
danieldk committed 1 year ago
Verified c8c7ccd3
fix build.rs watch files (#2072)
zirconium-n committed 1 year ago
Verified 0f7d38e7
Contributing guide & Code of Conduct (#2074)
LysandreJik committed 1 year ago
Verified 13183891
Support different image sizes in prefill in VLMs (#2065)
danieldk committed 1 year ago
Verified e9037708
Adding architecture document (#2044)
tengomucho committed 1 year ago
Verified 445f3135
Update the link for qwen2 (#2068)
xianbaoqian committed 1 year ago
Verified 96b7b40c
Add support for GPTQ Marlin (#2052)
danieldk committed 1 year ago
Verified 093a27c5
implement Open Inference Protocol endpoints (#1942)
drbh committed 1 year ago
Verified f433f1f7
PR #2049 CI run (#2054)
drbh committed 1 year ago
Verified 42aa8ee1
fix tests
OlivierDehaene committed 1 year ago
abe52120
allocate 16 by 16
OlivierDehaene committed 1 year ago
05eb4dcb
fix(layers): fix SuRotaryEmbedding (#2060)
OlivierDehaene committed 1 year ago
Verified 90184df7
fix(server): fix OPT implementation (#2061)
OlivierDehaene committed 1 year ago
Verified 521de6ca
remove slots from grpc
OlivierDehaene committed 1 year ago
9ac7b7bc
fix windowing
OlivierDehaene committed 1 year ago
c2fb459b
fix rust and python unit-tests
OlivierDehaene committed 1 year ago
37266e2d
Support chat response format (#2046)
drbh committed 1 year ago
Verified 376a0b7a
Update LLMM1 bound (#2050)
fxmarty committed 1 year ago
Verified a6e4d63c
FlashCausalLM implem
OlivierDehaene committed 1 year ago
73c39032
small refactor
OlivierDehaene committed 1 year ago
6983ec95
re-working logic, wip
OlivierDehaene committed 1 year ago
713d70b4
add terminated_generations
OlivierDehaene committed 1 year ago
298bf31e
fix python tests
OlivierDehaene committed 1 year ago
3c596983
Terms Of Use Privacy Policy Refund Policy Impressum