huggingface/text-generation-inference

Pull Requests Commits
fix discard_names bug in safetensors convertion (#1052)
zhangsibo1129 committed 2 years ago
Verified eba6ab1c
support local model config file (#1058)
zhangsibo1129 committed 2 years ago
Verified edc95a0e
Fix GQA llama + AWQ (#1061)
Narsil committed 2 years ago
Verified 2f51645a
Add AWQ quantization inference support (#1019) (#1054)
Narsil committed 2 years ago
Verified c5de7cd8
Fixing t5 loading. (#1042)
Narsil committed 2 years ago
Verified fef36cea
Fix missing arguments in Galactica's from_pb (#1022)
Vinno97 committed 2 years ago
Verified 123749a3
enable bfloat16 for cpu (#1034)
sywangyi committed 2 years ago
Verified eeaa22ab
Unsupported model serving docs (#906)
merveenoyan committed 2 years ago
Verified c8a01d75
Quantization docs (#911)
merveenoyan committed 2 years ago
Verified e9ae6786
Tensor Parallelism conceptual guide (#886)
merveenoyan committed 2 years ago
Verified 1f69fb9e
fit for baichuan models (#981)
XiaoBin1992 committed 2 years ago
Verified 4cce8430
Paged Attention Conceptual Guide (#901)
merveenoyan committed 2 years ago
Verified 30a93a0d
Fix __call__ vs forward. (#993)
Narsil committed 2 years ago
Verified 0a63e9ab
Safetensors conceptual guide (#905)
merveenoyan committed 2 years ago
Verified af1ed38f
add transformers gptq support (#963)
flozi00 committed 2 years ago
Verified b03d2621
Fix exllama wronfully loading (#990)
maximelaboisson committed 2 years ago
Verified 935a77fb
docs: Remove redundant content from stream guide (#884)
osanseviero committed 2 years ago
Verified a9fdfb24
docs: Flash Attention Conceptual Guide (#892)
merveenoyan committed 2 years ago
Verified f260eb72
chore: sync text-generation version from 0.3.0 to 0.6.0 with pyproject.toml (#950)
yzbx committed 2 years ago
Verified 059bb5cf
Disabling exllama on old compute. (#986)
Narsil committed 2 years ago
Verified 211e7b7e
docs: typo in streaming.js (#971)
Julien Bouquillon committed 2 years ago
Verified 3ed4c0f3
chore(client): Support Pydantic 2 (#900)
JelleZijlstra committed 2 years ago
Verified c8bbbd81
Backport https://github.com/vllm-project/vllm/pull/936 (#977)
Narsil committed 2 years ago
Verified 033230ae
small fix on idefics (#954)
VictorSanh committed 2 years ago
Verified 2bc287bf
Fixing top_k tokens when k ends up < 0 (#966)
Narsil committed 2 years ago
Verified 4f5d93ec
Fix Falcon weight mapping for H2O.ai checkpoints (#953)
Vinno97 committed 2 years ago
Verified 8a5f5649
Update version in docs (#957)
osanseviero committed 2 years ago
Verified 7d8e5fb2
Fix f180 (#951)
Narsil committed 2 years ago
Verified 7c2e0af2
New release. (#941)
Narsil committed 2 years ago
Verified 5485c142
Rebased #617 (#868)
Narsil committed 2 years ago
Verified 211b54ac
Terms Of Use Privacy Policy Refund Policy Impressum