huggingface/text-generation-inference

Pull Requests Commits
fix: slice stopping criteria buffer
OlivierDehaene committed 2 years ago
80a69204
fix: fix quant linear autotune
OlivierDehaene committed 2 years ago
083c2de9
fix: fix triton OutOfResources import
OlivierDehaene committed 2 years ago
773aabdd
feat: add more latency metrics in forward (#1346)
OlivierDehaene committed 2 years ago
Verified 50b495f3
fix: fix gpt-q params loading
OlivierDehaene committed 2 years ago
44b267ab
fix: default max_new_tokens to 100
OlivierDehaene committed 2 years ago
28821bfd
v1.3.2
OlivierDehaene committed 2 years ago
88aae259
feat: add quant to mixtral (#1337)
OlivierDehaene committed 2 years ago
Verified 82670d97
v1.3.1
OlivierDehaene committed 2 years ago
ec6d4592
v1.3.0
OlivierDehaene committed 2 years ago
d0841cc8
chore: formatting
OlivierDehaene committed 2 years ago
72ee382d
feat: mixtral (#1328)
OlivierDehaene committed 2 years ago
Verified 3a521c92
Speculative (#1308)
Narsil committed 2 years ago
Verified 9ecfa16b
Add a stale bot. (#1313)
Narsil committed 2 years ago
Verified 3238c491
Fix AMD documentation (#1307)
fxmarty committed 2 years ago
Verified 25b5f819
v1.2.0
OlivierDehaene committed 2 years ago
ccd5725a
Make GPTQ test less flaky (#1295)
Narsil committed 2 years ago
Verified 624800c4
Let each model resolve their own default dtype. (#1287)
Narsil committed 2 years ago
Verified ba552e1a
`make install-flash-attn-v2-cuda` should work like `make install-flash-attn-v2` used to work. (#1294)
Narsil committed 2 years ago
Verified 3c71c656
Add RoCm support (#1243)
fxmarty committed 2 years ago
Verified b2b5df0e
Exllama v2 (#1211)
Narsil committed 2 years ago
Verified ed2a3f61
Reduce race condition on file system for test
Narsil committed 2 years ago
3c02262f
Fix IDEFICS dtype (#1214)
vakker committed 2 years ago
Verified c6bb7670
chore: update to torch 2.1.0 (#1182)
OlivierDehaene committed 2 years ago
Verified 35509ff5
Load PEFT weights from local directory (#1260)
tleyden committed 2 years ago
Verified e12c34bd
Fix missing `trust_remote_code` flag for AutoTokenizer in utils.peft (#1270)
creatorrr committed 2 years ago
Verified 91111a0d
Update README.md (#1272)
Narsil committed 2 years ago
Verified b226e469
fix: do not leak inputs on error (#1228)
OlivierDehaene committed 2 years ago
Verified 3dbc649b
hotfix 1.1.1
OlivierDehaene committed 2 years ago
8acdc1fa
v1.1.1
OlivierDehaene committed 2 years ago
457e72c3
Terms Of Use Privacy Policy Refund Policy Impressum