huggingface/text-generation-inference

Pull Requests Commits

Update the doc.

Narsil committed 1 year ago

f66c9f34

Update launcher/src/main.rs

Narsil committed 1 year ago

Verified b75bd5b7

Forgot the doc again.

Narsil committed 1 year ago

16386b83

Smaller default for max_input_length.

Narsil committed 1 year ago

e5955851

"Fixing t5" just use more RAM for this test.

Narsil committed 1 year ago

1e5150f4

Max_seq_len (old mpt config.)

Narsil committed 1 year ago

cd072114

Fixing default for BNB + cuda graphs (they don't work together).

Narsil committed 1 year ago

c4ebcea7

Adding some wiggle room.

Narsil committed 1 year ago

289b0721

Remove the override ?

Narsil committed 1 year ago

9176ecbc

Change things around when we don't have a tokenizer.

Narsil committed 1 year ago

179ee4e2

Making things work most of the time.

Narsil committed 1 year ago

d43e10e0

Narsil committed 1 year ago

9ce9f39d

Update default doc.

Narsil committed 1 year ago

a4c86e86

Better defaults (and LOG_COLORIZE).

Narsil committed 1 year ago

bd01d448

Easier defaults for models stemmed from configs.

Narsil committed 1 year ago

3c71d2f1

Upgrade EETQ (Fixes the cuda graphs). (#1729)

Narsil committed 1 year ago

Verified 6c2c44b8

Fp8 Support (#1726)

Narsil committed 1 year ago

Verified 408dbc48

Dev/mask ldconfig output v2 (#1716)

oOraph committed 1 year ago

Verified c2fd35d8

Revert "Easier defaults for models stemmed from configs."

Narsil committed 1 year ago

842f6658

Easier defaults for models stemmed from configs.

Narsil committed 1 year ago

b83aab9b

Update libraries (#1713)

abhishekkrthakur committed 1 year ago

Verified 10d9083b

hotfix: mixtral

OlivierDehaene committed 1 year ago

30620a9a

fix: fix CohereForAI/c4ai-command-r-plus (#1707)

OlivierDehaene committed 1 year ago

Verified ad9d6288

Adding Llava-Next (Llava 1.6) with full support. (#1709)

Narsil committed 1 year ago

Verified 4634b00c

Automatic quantization config. (#1719)

Narsil committed 1 year ago

Verified 106d8ee8

Revert license to Apache 2.0 (#1714)

OlivierDehaene committed 1 year ago

Verified ff42d33e

Regenerate ld.so.cache (#1708)

oOraph committed 1 year ago

Verified 53c2c3db

Force weights_only (before fully breaking pickle files anyway). (#1710)

Narsil committed 1 year ago

Verified 8dca3b04

Fixing cohere tokenizer. (#1697)

Narsil committed 1 year ago

Verified f9958ee1

Push users to streaming in the readme. (#1698)

Narsil committed 1 year ago

Verified 5062fda4

Older