huggingface/text-generation-inference

Pull Requests Commits

fix: reset grammar state when generation stops

drbh committed 1 year ago

e6259d9f

OlivierDehaene committed 1 year ago

2d0a7173

Upgrading all versions. (#1759)

Narsil committed 1 year ago

Verified f9ee2c41

feat: accept list as prompt and use first string (#1702)

drbh committed 1 year ago

Verified 06c3d4b1

fix: bump clients test base url to llama (#1751)

drbh committed 1 year ago

Verified e4d31a40

Update response type for `/v1/chat/completions` and `/v1/completions` (#1747)

Wauplin committed 1 year ago

Verified 00f36535

feat: improve tools to include name and add tests (#1693)

drbh committed 1 year ago

Verified 7276d434

Fixing CI. (#1748)

Narsil committed 1 year ago

Verified 88702d87

OlivierDehaene committed 1 year ago

Verified c38a7d7d

Fix typo in guidance.md (#1735)

eltociear committed 1 year ago

Verified 275caa04

feat: medusa v2 (#1734)

OlivierDehaene committed 1 year ago

Verified eefea5ee

Improve the defaults for the launcher (#1727)

Narsil committed 1 year ago

Verified 1b2670c8

chore(cargo-toml): apply lto fat and codegen-units of one (#1651)

somehowchris committed 1 year ago

Verified 9d8f21ca

fix(router): fix a possible deadlock in next_batch (#1731)

OlivierDehaene committed 1 year ago

Verified c2c98725

Upgrade EETQ (Fixes the cuda graphs). (#1729)

Narsil committed 1 year ago

Verified 6c2c44b8

Fp8 Support (#1726)

Narsil committed 1 year ago

Verified 408dbc48

Dev/mask ldconfig output v2 (#1716)

oOraph committed 1 year ago

Verified c2fd35d8

Revert "Easier defaults for models stemmed from configs."

Narsil committed 1 year ago

842f6658

Easier defaults for models stemmed from configs.

Narsil committed 1 year ago

b83aab9b

Update libraries (#1713)

abhishekkrthakur committed 1 year ago

Verified 10d9083b

hotfix: mixtral

OlivierDehaene committed 1 year ago

30620a9a

fix: fix CohereForAI/c4ai-command-r-plus (#1707)

OlivierDehaene committed 1 year ago

Verified ad9d6288

Adding Llava-Next (Llava 1.6) with full support. (#1709)

Narsil committed 1 year ago

Verified 4634b00c

Automatic quantization config. (#1719)

Narsil committed 1 year ago

Verified 106d8ee8

Revert license to Apache 2.0 (#1714)

OlivierDehaene committed 1 year ago

Verified ff42d33e

Regenerate ld.so.cache (#1708)

oOraph committed 1 year ago

Verified 53c2c3db

Force weights_only (before fully breaking pickle files anyway). (#1710)

Narsil committed 1 year ago

Verified 8dca3b04

Fixing cohere tokenizer. (#1697)

Narsil committed 1 year ago

Verified f9958ee1

Push users to streaming in the readme. (#1698)

Narsil committed 1 year ago

Verified 5062fda4

Pickle conversion now requires `--trust-remote-code`. (#1704)

Narsil committed 1 year ago

Verified c7e570e5

Older