huggingface/text-generation-inference

Pull Requests Commits

Regenerate ld.so.cache (#1708)

oOraph committed 1 year ago

Verified 53c2c3db

Force weights_only (before fully breaking pickle files anyway). (#1710)

Narsil committed 1 year ago

Verified 8dca3b04

Fixing cohere tokenizer. (#1697)

Narsil committed 1 year ago

Verified f9958ee1

Push users to streaming in the readme. (#1698)

Narsil committed 1 year ago

Verified 5062fda4

Pickle conversion now requires `--trust-remote-code`. (#1704)

Narsil committed 1 year ago

Verified c7e570e5

Add cuda graphs sizes and make it default. (#1703)

Narsil committed 1 year ago

Verified 99874eae

OlivierDehaene committed 1 year ago

Verified 4ee0a0c4

feat: Add dbrx support (#1685)

OlivierDehaene committed 1 year ago

Verified f04255c6

fix: handle batches with and without grammars (#1676)

drbh committed 1 year ago

Verified 762dbf3f

fix: adjust logprob response logic (#1682)

drbh committed 1 year ago

Verified 818aee37

OlivierDehaene committed 1 year ago

Verified 6c4496a1

feat: cohere (#1660)

OlivierDehaene committed 1 year ago

Verified 1e9bcd9d

Inline images for multimodal models. (#1666)

Narsil committed 1 year ago

Verified f171bdc8

fix: LlamaTokenizerFast to AutoTokenizer at flash_mistral.py (#1637)

SeongBeomLEE committed 1 year ago

Verified 66914f7b

feat: update client to 0.7 (#1667)

OlivierDehaene committed 1 year ago

Verified 08e91814

Repair idefics integration tests. (#1663)

Narsil committed 1 year ago

Verified deb440b3

Remove unecessary cuda graph. (#1664)

Narsil committed 1 year ago

Verified ed29d6ee

fix: improve tool type, bump pydantic and outlines (#1650)

drbh committed 1 year ago

Verified de6cb15f

fix: prefer spaces url over temp url (#1662)

drbh committed 1 year ago

Verified 4f09c80c

feat: support force downcast after FastRMSNorm multiply for Gemma (#1658)

drbh committed 1 year ago

Verified 6f15ac60

feat: bump minijina and add test for core templates (#1626)

drbh committed 1 year ago

Verified dfbd9a39

Fixing minor typo in documentation: supported hardware section (#1632)

SachinVarghese committed 1 year ago

Verified 0d72af5a

Fix index in ChatCompletionChunk (#1648)

Wauplin committed 1 year ago

Verified 23fba672

Update peft + transformers + accelerate + bnb + safetensors (#1646)

abhishekkrthakur committed 1 year ago

Verified 0d9917f7

Upgrade nix version from 0.27.1 to 0.28.0 (#1638)

yuanwu2017 committed 1 year ago

Verified 8a5bcba2

Use a better model for the quick tour (#1639)

lewtun committed 1 year ago

Verified d3711a66

fix: correctly index into mask when applying grammar (#1618)

drbh committed 1 year ago

Verified 7dbaf9e9

fix: add missing stop parameter for chat request (#1619)

drbh committed 1 year ago

Verified 7e087513

feat: accept legacy request format and response (#1527)

drbh committed 1 year ago

Verified 3dd7da21

Fix async client timeout (#1617)

hugoabonizio committed 1 year ago

Verified 9ed4d2c7

Newer Older