huggingface/text-generation-inference

Pull Requests Commits

misc(ci): let's use the correct way to invoke sccache

mfuntowicz committed 1 year ago

1ca37d33

glegendre01 committed 1 year ago

Verified 9c851933

misc(ci): let's try to build with sccache

mfuntowicz committed 1 year ago

f3d6e847

misc(ci): lets do differently

mfuntowicz committed 1 year ago

cda97a5c

glegendre01 committed 1 year ago

Verified f7eaf2be

glegendre01 committed 1 year ago

Verified 600faa6d

misc(ci): enable the wf on the current branch

mfuntowicz committed 1 year ago

1c3f82c5

misc(ci): install sccache

mfuntowicz committed 1 year ago

d32411c4

misc(ci): we cannot specify version on a local wf

mfuntowicz committed 1 year ago

192da621

misc(ci): again

mfuntowicz committed 1 year ago

51af4121

misc(ci): ok let's simplify

mfuntowicz committed 1 year ago

8050420d

misc(ci): make runner-group input a string

mfuntowicz committed 1 year ago

c8623e41

feat(trtllm): add trtllm build workflow and update s3-cache

mfuntowicz committed 1 year ago

5bef5a88

glegendre01 committed 1 year ago

Verified 951cc51a

Create test-s3-cache.yaml

glegendre01 committed 1 year ago

Verified 5e954be6

Using both value from config as they might not be correct. (#2817)

Narsil committed 1 year ago

Verified 82c24f74

Small update to docs (#2816)

Narsil committed 1 year ago

Verified a2d878fa

Hotfix link2 (#2812)

Narsil committed 1 year ago

Verified b2fac5d9

Hotfixing the link. (#2811)

Narsil committed 1 year ago

Verified a70dd299

Prep new version (#2810)

Narsil committed 1 year ago

Verified 042791fb

Narsil committed 1 year ago

Verified 27fa83ca

Attempt for cleverer auto batch_prefill values (some simplifications). (#2808)

Narsil committed 1 year ago

Verified a04356fb

Enable paligemma2 (#2807)

drbh committed 1 year ago

Verified 9f5c9a5e

Removing experimental to prefill chunking.

Narsil committed 1 year ago

Verified 08f6fa0b

Adding A100 compute. (#2806)

Narsil committed 1 year ago

Verified d96dcb17

Auto max prefill (#2797)

Narsil committed 1 year ago

Verified 5df80590

feat: auto max_new_tokens (#2803)

OlivierDehaene committed 1 year ago

Verified 8c3669b2

use oneapi 2024 docker image directly for xpu (#2793)

sywangyi committed 1 year ago

Verified 6685e8fc

fix: avoid setting use_sgmv if no kernels present (#2796)

drbh committed 1 year ago

Verified e0db6333

Saving some VRAM. (#2790)

Narsil committed 1 year ago

Verified b57f3703

Older