huggingface/text-generation-inference

Pull Requests Commits

Added InferenceClient

merveenoyan committed 2 years ago

Verified e994ad11

Added consuming TGI with ChatUI

merveenoyan committed 2 years ago

Verified bb83f333

merveenoyan committed 2 years ago

Verified 564bc99a

Separated querying section and emphasized self generating docs

merveenoyan committed 2 years ago

Verified 470dcdfe

Added supported models and hardware

merveenoyan committed 2 years ago

Verified 21ca70e0

Update local_launch.md

merveenoyan committed 2 years ago

Verified 2675d934

Update build_pr_documentation.yml

merveenoyan committed 2 years ago

Verified c86dcbee

Update build_pr_documentation.yml

merveenoyan committed 2 years ago

Verified d65bbb33

Added installation and launch notes and re-structured toc

merveenoyan committed 2 years ago

Verified b2268272

Added index.md and other initial files

merveenoyan committed 2 years ago

Verified 41bd0e4a

Setup for doc-builder and added TOC

merveenoyan committed 2 years ago

Verified dc631b5b

Local gptq support. (#738)

Narsil committed 2 years ago

Verified 92bb56b0

OlivierDehaene committed 2 years ago

Verified 3ef5ffbc

chore: update license to HFOIL (#725)

OlivierDehaene committed 2 years ago

Verified bde25e62

feat(server): update vllm version (#723)

OlivierDehaene committed 2 years ago

Verified afd04dc7

docs: Add hardware section to TOC in README (#721)

regisss committed 2 years ago

Verified f848dece

Add section about TGI on other AI hardware accelerators in README (#715)

regisss committed 2 years ago

Verified 5a1cccbb

OlivierDehaene committed 2 years ago

Verified 9f18f4c0

feat(server): support new falcon config (#712)

OlivierDehaene committed 2 years ago

Verified ab96b9ae

fix(server): fix missing datasets in quantize

OlivierDehaene committed 2 years ago

2efd46ef

fix(server): fix quantization python requirements (#708)

OlivierDehaene committed 2 years ago

Verified 8bd0adb1

docs(README): update readme

OlivierDehaene committed 2 years ago

e64a6589

feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)

Narsil committed 2 years ago

Verified a0d55358

fix(server): fix exllama buffers (#689)

OlivierDehaene committed 2 years ago

Verified 37df6df3

feat: add cuda memory fraction (#659)

OlivierDehaene committed 2 years ago

Verified 73a4d65d

feat(server): add local prom and health routes if running w/ ngrok

OlivierDehaene committed 2 years ago

1da642bd

Directly load GPTBigCode to specified device (#618)

Atry committed 2 years ago

Verified 15b3e9ff

feat(server): Add exllama GPTQ CUDA kernel support #553 (#666)

Narsil committed 2 years ago

Verified d5b5bc75

fix(server): use mem_get_info to get kv cache size (#664)

OlivierDehaene committed 2 years ago

Verified bf94df3c

fix(server): Fixing non parameters in quantize script `bigcode/starcoder` was an example. (#661)

Narsil committed 2 years ago

Verified 08b8eec1

Older