huggingface/text-generation-inference

Pull Requests Commits

Narsil committed 2 years ago

33958e09

fit for baichuan models (#981)

XiaoBin1992 committed 2 years ago

Verified 4cce8430

Paged Attention Conceptual Guide (#901)

merveenoyan committed 2 years ago

Verified 30a93a0d

Fix __call__ vs forward. (#993)

Narsil committed 2 years ago

Verified 0a63e9ab

Safetensors conceptual guide (#905)

merveenoyan committed 2 years ago

Verified af1ed38f

add transformers gptq support (#963)

flozi00 committed 2 years ago

Verified b03d2621

Fix exllama wronfully loading (#990)

maximelaboisson committed 2 years ago

Verified 935a77fb

docs: Remove redundant content from stream guide (#884)

osanseviero committed 2 years ago

Verified a9fdfb24

docs: Flash Attention Conceptual Guide (#892)

merveenoyan committed 2 years ago

Verified f260eb72

chore: sync text-generation version from 0.3.0 to 0.6.0 with pyproject.toml (#950)

yzbx committed 2 years ago

Verified 059bb5cf

Disabling exllama on old compute. (#986)

Narsil committed 2 years ago

Verified 211e7b7e

docs: typo in streaming.js (#971)

Julien Bouquillon committed 2 years ago

Verified 3ed4c0f3

chore(client): Support Pydantic 2 (#900)

JelleZijlstra committed 2 years ago

Verified c8bbbd81

Backport https://github.com/vllm-project/vllm/pull/936 (#977)

Narsil committed 2 years ago

Verified 033230ae

small fix on idefics (#954)

VictorSanh committed 2 years ago

Verified 2bc287bf

Fixing top_k tokens when k ends up < 0 (#966)

Narsil committed 2 years ago

Verified 4f5d93ec

Fix Falcon weight mapping for H2O.ai checkpoints (#953)

Vinno97 committed 2 years ago

Verified 8a5f5649

Update version in docs (#957)

osanseviero committed 2 years ago

Verified 7d8e5fb2

Fix f180 (#951)

Narsil committed 2 years ago

Verified 7c2e0af2

New release. (#941)

Narsil committed 2 years ago

Verified 5485c142

Rebased #617 (#868)

Narsil committed 2 years ago

Verified 211b54ac

Fixing the lora adaptation on docker. (#935)

Narsil committed 2 years ago

Verified 4486f78c

Supporting code llama. (#918)

Narsil committed 2 years ago

Verified e605c2a4

Added gradio example to docs (#867)

merveenoyan committed 2 years ago

Verified 97444f93

Upgrade version number in docs. (#910)

Narsil committed 2 years ago

Verified 888c0291

Adding small benchmark script. (#881)

Narsil committed 2 years ago

Verified c4422e56

Add streaming guide (#858)

osanseviero committed 2 years ago

Verified bfa07061

Adding Idefics multi modal model. (#842)

Narsil committed 2 years ago

Verified bce5e224

Upgrading versions of python client. (#862)

Narsil committed 2 years ago

Verified b9e33c49

"Fix" for rw-1b. (#860)

Narsil committed 2 years ago

Verified 2e68ac01

Older