huggingface/text-generation-inference

Pull Requests Commits

OlivierDehaene committed 1 year ago

a42dc202

OlivierDehaene committed 1 year ago

ef996787

Revamp medusa implementation so that every model can benefit. (#1588)

Narsil committed 1 year ago

Verified bf700e7e

fix: avoid default message (#1579)

drbh committed 1 year ago

Verified ac5a1c6f

fix: fix openapi schema (#1586)

OlivierDehaene committed 1 year ago

Verified 010508ce

OlivierDehaene committed 1 year ago

Verified 9c1cb81c

feat: add support for Gemma (#1583)

OlivierDehaene committed 1 year ago

Verified c86f58d3

fix(router): fix openapi and add jsonschema validation (#1578)

OlivierDehaene committed 1 year ago

Verified fa8a8e05

fix: refactor syntax to correctly include structs (#1580)

drbh committed 1 year ago

Verified c9f4c1af

improve endpoint support (#1577)

drbh committed 1 year ago

Verified df230625

Fix mistral with length > window_size for long prefills (rotary doesn't create long enough cos, sin). (#1571)

Narsil committed 1 year ago

Verified d19c768c

OlivierDehaene committed 1 year ago

Verified 4139054b

feat: add chat template struct to avoid tuple ordering errors (#1570)

OlivierDehaene committed 1 year ago

Verified 0f2daad8

chore: add pre-commit (#1569)

OlivierDehaene committed 1 year ago

Verified 9946165e

Bugfix: eos and bos tokens positions are inconsistent (#1567)

amihalik committed 1 year ago

Verified 142cdabe

Added `name` field to OpenAI compatible API Messages (#1563)

amihalik committed 1 year ago

Verified c55abac3

Outlines guided generation (#1539)

drbh committed 1 year ago

Verified cef0553d

Small cleanup. (#1560)

Narsil committed 1 year ago

Verified 4c2848b2

Improving mamba runtime by using updates (#1552)

Narsil committed 1 year ago

Verified d6b0fb9e

Upgrade intermediary layer for nvidia too. (#1557)

Narsil committed 1 year ago

Verified 7671a419

Fixing glibc version in the runtime. (#1556)

Narsil committed 1 year ago

Verified 6f68bb14

feat: add deserialize_with that handles strings or objects with content (#1550)

drbh committed 1 year ago

Verified 246ad39d

feat: experimental support for cuda graphs (#1428)

OlivierDehaene committed 1 year ago

Verified 0d794af6

feat(router): add max_batch_size (#1542)

OlivierDehaene committed 1 year ago

Verified 53214633

ROCm AWQ support (#1514)

IlyasMoutawwakil committed 1 year ago

Verified a4e58016

chore: bump ci rust version (#1543)

drbh committed 1 year ago

Verified c5ef81be

feat(server): add frequency penalty (#1541)

OlivierDehaene committed 1 year ago

Verified 09b7c26b

Update to peft 0.8.2 (#1537)

Stillerman committed 1 year ago

Verified 39af000c

Impl simple mamba model (#1480)

drbh committed 1 year ago

Verified bd405e03

feat: use existing add_generation_prompt variable from config in temp… (#1533)

drbh committed 1 year ago

Verified 17345402

Older