huggingface/text-generation-inference

Pull Requests Commits
Fixing intel Supports windowing. (#2637)
Narsil committed 2 years ago
Verified 0c478846
Intel ci (#2630)
Narsil committed 2 years ago
Verified 3dbdf63e
Update documentation to most recent stable version of TGI. (#2625)
Vaibhavs10 committed 2 years ago
Verified d912f0bf
feat: allow tool calling to respond without a tool (#2614)
drbh committed 2 years ago
Verified e36dfaa8
AMD CI (#2589)
Narsil committed 2 years ago
Verified 43f39f68
nix: add black and isort to the closure (#2619)
danieldk committed 2 years ago
Verified 9ed0c85f
CI (2599): Update ToolType input schema (#2601)
drbh committed 2 years ago
Verified 8ad20daf
nix: move back to the tgi-nix main branch (#2620)
danieldk committed 2 years ago
Verified 6db3bcb7
Add support for fused MoE Marlin for AWQ (#2616)
danieldk committed 2 years ago
Verified 64142489
Upgrade minor rust version (Fixes rust build compilation cache) (#2617)
Narsil committed 2 years ago
Verified 8b295aa4
enable mllama in intel platform (#2610)
sywangyi committed 2 years ago
Verified 57f9685d
Fix FP8 KV-cache condition (#2611)
flozi00 committed 2 years ago
Verified 0da4df4b
Add basic FP8 KV cache support (#2603)
danieldk committed 2 years ago
Verified 2358c2bb
nix: example of local package overrides during development (#2607)
danieldk committed 2 years ago
Verified 68103079
Revert "Unroll notify error into generate response" (#2605)
drbh committed 2 years ago
Verified 3011639f
New release 2.3.1 (#2604)
Narsil committed 2 years ago
Verified f6e2f05b
Unroll notify error into generate response (#2597)
drbh committed 2 years ago
Verified d22b0c1f
CI (2592): Allow LoRA adapter revision in server launcher (#2602)
drbh committed 2 years ago
Verified 23354595
Max token capacity metric (#2595)
Narsil committed 2 years ago
Verified 0204946d
Mllama flash version (#2585)
Narsil committed 2 years ago
Verified d18ed5cf
nix: experimental support for building a Docker container (#2470)
danieldk committed 2 years ago
Verified 584b4d7a
MoE Marlin: support `desc_act` for `groupsize != -1` (#2590)
danieldk committed 2 years ago
Verified 1c84a30f
Move flake back to tgi-nix `main` (#2586)
danieldk committed 2 years ago
Verified d1f257ac
feat: support phi3.5 moe (#2479)
drbh committed 2 years ago
Verified 93a7042d
Add support for GPTQ-quantized MoE models using MoE Marlin (#2557)
danieldk committed 2 years ago
Verified 90a1d04a
Update ROCM libs and improvements (#2579)
mht-sharma committed 2 years ago
Verified f9e561ec
Update architecture.md (#2577)
ulhaqi12 committed 2 years ago
Verified e790cfc0
Remove compute capability lazy cell (#2580)
danieldk committed 2 years ago
Verified afc7ded8
flashinfer: pass window size and dtype (#2574)
danieldk committed 2 years ago
Verified 1028996f
Improve support for GPUs with capability < 8 (#2575)
danieldk committed 2 years ago
Verified 5b6b74e2
Terms Of Use Privacy Policy Refund Policy Impressum