huggingface/text-generation-inference

Pull Requests Commits

fix: include shared python library during rust build step

drbh committed 1 year ago

b5dcc874

fix: check start_states len and add states_to_token_maps to filter

drbh committed 1 year ago

65b5b4c3

fix: remove GrammarType import typo

drbh committed 1 year ago

5b5cbb14

fix: remove compilation artifacts from logit processor

drbh committed 1 year ago

d031919c

feat: remove uncompile grammar and improve logit processor logic

drbh committed 1 year ago

1f7be736

feat: prefer precompiled grammar

drbh committed 1 year ago

c52a0f67

feat: compile grammar and send over grpc

drbh committed 1 year ago

4f7074ca

feat: support grammar compilation worker via py03

drbh committed 1 year ago

ad5f562a

fix: correctly index into mask when applying grammar (#1618)

drbh committed 1 year ago

Verified 7dbaf9e9

fix: add missing stop parameter for chat request (#1619)

drbh committed 1 year ago

Verified 7e087513

feat: accept legacy request format and response (#1527)

drbh committed 1 year ago

Verified 3dd7da21

Fix async client timeout (#1617)

hugoabonizio committed 1 year ago

Verified 9ed4d2c7

Fix idefics default. (#1614)

Narsil committed 1 year ago

Verified 5a3903ba

fix: Handle concurrent grammar requests (#1610)

drbh committed 1 year ago

Verified 343aa7a1

OlivierDehaene committed 1 year ago

Verified e6bb3ff8

feat: Qwen2 (#1608)

OlivierDehaene committed 1 year ago

Verified 26cdea5c

feat: starcoder2 (#1605)

OlivierDehaene committed 1 year ago

Verified b40e8334

Fixing guidance docs. (#1607)

Narsil committed 1 year ago

Verified 97e22369

Fixing x-compute-time. (#1606)

Narsil committed 1 year ago

Verified 910d0a90

Support tools (#1587)

drbh committed 1 year ago

Verified 9b6db5f7

Revamp medusa implementation so that every model can benefit. (#1588)

Narsil committed 1 year ago

Verified bf700e7e

fix: avoid default message (#1579)

drbh committed 1 year ago

Verified ac5a1c6f

fix: fix openapi schema (#1586)

OlivierDehaene committed 1 year ago

Verified 010508ce

OlivierDehaene committed 1 year ago

Verified 9c1cb81c

feat: add support for Gemma (#1583)

OlivierDehaene committed 1 year ago

Verified c86f58d3

fix(router): fix openapi and add jsonschema validation (#1578)

OlivierDehaene committed 1 year ago

Verified fa8a8e05

fix: refactor syntax to correctly include structs (#1580)

drbh committed 1 year ago

Verified c9f4c1af

improve endpoint support (#1577)

drbh committed 1 year ago

Verified df230625

Fix mistral with length > window_size for long prefills (rotary doesn't create long enough cos, sin). (#1571)

Narsil committed 1 year ago

Verified d19c768c

OlivierDehaene committed 1 year ago

Verified 4139054b

Older