huggingface/text-generation-inference

Pull Requests Commits

feat: add chat template struct to avoid tuple ordering errors (#1570)

OlivierDehaene committed 1 year ago

Verified 0f2daad8

chore: add pre-commit (#1569)

OlivierDehaene committed 1 year ago

Verified 9946165e

Bugfix: eos and bos tokens positions are inconsistent (#1567)

amihalik committed 1 year ago

Verified 142cdabe

Added `name` field to OpenAI compatible API Messages (#1563)

amihalik committed 1 year ago

Verified c55abac3

Outlines guided generation (#1539)

drbh committed 1 year ago

Verified cef0553d

Small cleanup. (#1560)

Narsil committed 1 year ago

Verified 4c2848b2

Improving mamba runtime by using updates (#1552)

Narsil committed 1 year ago

Verified d6b0fb9e

Upgrade intermediary layer for nvidia too. (#1557)

Narsil committed 1 year ago

Verified 7671a419

Fixing glibc version in the runtime. (#1556)

Narsil committed 1 year ago

Verified 6f68bb14

feat: add deserialize_with that handles strings or objects with content (#1550)

drbh committed 1 year ago

Verified 246ad39d

feat: experimental support for cuda graphs (#1428)

OlivierDehaene committed 1 year ago

Verified 0d794af6

feat(router): add max_batch_size (#1542)

OlivierDehaene committed 1 year ago

Verified 53214633

ROCm AWQ support (#1514)

IlyasMoutawwakil committed 1 year ago

Verified a4e58016

chore: bump ci rust version (#1543)

drbh committed 1 year ago

Verified c5ef81be

feat(server): add frequency penalty (#1541)

OlivierDehaene committed 1 year ago

Verified 09b7c26b

Update to peft 0.8.2 (#1537)

Stillerman committed 1 year ago

Verified 39af000c

Impl simple mamba model (#1480)

drbh committed 1 year ago

Verified bd405e03

feat: use existing add_generation_prompt variable from config in temp… (#1533)

drbh committed 1 year ago

Verified 17345402

feat: add ie update to message docs (#1523)

drbh committed 1 year ago

Verified 0da00be5

[docs] Fix link to Install CLI (#1526)

pcuenca committed 1 year ago

Verified 3ab578b4

Updating tokenizers. (#1517)

Narsil committed 1 year ago

Verified 0e97af45

fix: tokenizer config should use local model path when possible (#1518)

drbh committed 1 year ago

Verified ee1cf51c

Revert "Modify default for max_new_tokens in python client (#1336)"

Narsil committed 1 year ago

1e03b61b

Hotfix the / health - route. (#1515)

Narsil committed 1 year ago

Verified 9ad7b6a1

Freshen up the README.

Narsil committed 1 year ago

94d243b3

GPTNeoX: Use static rotary embedding (#1498)

dwyatte committed 1 year ago

Verified 13c62be4

fix: improve messages api docs content and formatting (#1506)

drbh committed 1 year ago

Verified 2ae36a97

feat: eetq gemv optimization when batch_size <= 4 (#1502)

dtlzhuangz committed 1 year ago

Verified 0595bf3e

Modify default for max_new_tokens in python client (#1336)

freitng committed 1 year ago

Verified 2d56f106

Create the compute type at launch time (if not provided in the env). (#1505)

Narsil committed 1 year ago

Verified a9ea6068

Newer Older