huggingface/text-generation-inference

Pull Requests Commits

fix: add limit to internal stream function too

drbh committed 1 year ago

b3917ff6

fix: enforce default max request tokens in generate_internal

drbh committed 1 year ago

595640e3

Use flashinfer for Gemma 2.

danieldk committed 1 year ago

ce7e3565

Fixing linters. (#2650)

Narsil committed 1 year ago

Verified cf04a43f

feat: enable pytorch xpu support for non-attention models (#2561)

dvrogozh committed 1 year ago

Verified 58848cb4

update ipex to fix incorrect output of mllama in cpu (#2640)

sywangyi committed 1 year ago

Verified 7a82ddcb

Clarify gated description and quicktour (#2631)

osanseviero committed 1 year ago

Verified 51f54018

Cpu perf (#2596)

Narsil committed 1 year ago

Verified 3ea82d00

Small fixes for supported models (#2471)

osanseviero committed 1 year ago

Verified ce28ee88

Fixing intel Supports windowing. (#2637)

Narsil committed 1 year ago

Verified 0c478846

Intel ci (#2630)

Narsil committed 1 year ago

Verified 3dbdf63e

Update documentation to most recent stable version of TGI. (#2625)

Vaibhavs10 committed 1 year ago

Verified d912f0bf

feat: allow tool calling to respond without a tool (#2614)

drbh committed 1 year ago

Verified e36dfaa8

Narsil committed 1 year ago

Verified 43f39f68

nix: add black and isort to the closure (#2619)

danieldk committed 1 year ago

Verified 9ed0c85f

CI (2599): Update ToolType input schema (#2601)

drbh committed 1 year ago

Verified 8ad20daf

nix: move back to the tgi-nix main branch (#2620)

danieldk committed 1 year ago

Verified 6db3bcb7

Add support for fused MoE Marlin for AWQ (#2616)

danieldk committed 1 year ago

Verified 64142489

Upgrade minor rust version (Fixes rust build compilation cache) (#2617)

Narsil committed 1 year ago

Verified 8b295aa4

enable mllama in intel platform (#2610)

sywangyi committed 1 year ago

Verified 57f9685d

Fix FP8 KV-cache condition (#2611)

flozi00 committed 1 year ago

Verified 0da4df4b

Add basic FP8 KV cache support (#2603)

danieldk committed 1 year ago

Verified 2358c2bb

nix: example of local package overrides during development (#2607)

danieldk committed 1 year ago

Verified 68103079

Revert "Unroll notify error into generate response" (#2605)

drbh committed 1 year ago

Verified 3011639f

New release 2.3.1 (#2604)

Narsil committed 1 year ago

Verified f6e2f05b

Unroll notify error into generate response (#2597)

drbh committed 1 year ago

Verified d22b0c1f

CI (2592): Allow LoRA adapter revision in server launcher (#2602)

drbh committed 1 year ago

Verified 23354595

Max token capacity metric (#2595)

Narsil committed 1 year ago

Verified 0204946d

Mllama flash version (#2585)

Narsil committed 1 year ago

Verified d18ed5cf

nix: experimental support for building a Docker container (#2470)

danieldk committed 1 year ago

Verified 584b4d7a

Older