huggingface/text-generation-inference

Pull Requests Commits

Fixing lockfile.

Narsil committed 1 year ago

Verified 8f326c97

Preparing for v3 release.

Narsil committed 1 year ago

Verified 7b631e21

Hotfixing the link. (#2811)

Narsil committed 1 year ago

Verified a70dd299

Prep new version (#2810)

Narsil committed 1 year ago

Verified 042791fb

Narsil committed 1 year ago

Verified 27fa83ca

Attempt for cleverer auto batch_prefill values (some simplifications). (#2808)

Narsil committed 1 year ago

Verified a04356fb

Enable paligemma2 (#2807)

drbh committed 1 year ago

Verified 9f5c9a5e

Removing experimental to prefill chunking.

Narsil committed 1 year ago

Verified 08f6fa0b

Adding A100 compute. (#2806)

Narsil committed 1 year ago

Verified d96dcb17

Auto max prefill (#2797)

Narsil committed 1 year ago

Verified 5df80590

feat: auto max_new_tokens (#2803)

OlivierDehaene committed 1 year ago

Verified 8c3669b2

use oneapi 2024 docker image directly for xpu (#2793)

sywangyi committed 1 year ago

Verified 6685e8fc

fix: avoid setting use_sgmv if no kernels present (#2796)

drbh committed 1 year ago

Verified e0db6333

Saving some VRAM. (#2790)

Narsil committed 1 year ago

Verified b57f3703

Sync (most) server dependencies with Nix (#2782)

danieldk committed 1 year ago

Verified 2003d8be

fix: only use eos_token_id as pad_token_id if int (#2774)

dvrogozh committed 1 year ago

Verified 535149d8

fix: add merge-lora arg for model id (#2788)

drbh committed 1 year ago

Verified 2c74c556

Removing ../ that broke the link (#2789)

Getty committed 1 year ago

Verified a35d1e6f

Fix doc. (#2792)

Narsil committed 1 year ago

Verified 1d2cb356

Support continue final message (#2733)

drbh committed 1 year ago

Verified d4718051

Fix: docs typo (#2777)

jp1924 committed 1 year ago

Verified caff779d

upgrade ipex cpu to fix coredump in tiiuae/falcon-7b-instruct (pageat… (#2778)

sywangyi committed 1 year ago

Verified 892a26e5

Use FP8 KV cache when specified by compressed-tensors (#2761)

danieldk committed 1 year ago

Verified 72ab60fd

Move JSON grammar -> regex grammar conversion to the router (#2772)

danieldk committed 1 year ago

Verified 289aa485

feat: concat the adapter id to the model id in chat response (#2779)

drbh committed 1 year ago

Verified c637d68d

chore: prepare 2.4.1 release (#2773)

OlivierDehaene committed 1 year ago

Verified 780531ec

chore: Update to marlin-kernels 0.3.6 (#2771)

danieldk committed 1 year ago

Verified e87893d3

feat: add payload limit (#2726)

OlivierDehaene committed 1 year ago

Verified ab7ccf5b

feat: Add automatic nightly benchmarks (#2591)

Hugoch committed 1 year ago

Verified d5bc6a20

Remove guideline from API (#2762)

Wauplin committed 1 year ago

Verified d012f229

Older