huggingface/text-generation-inference

Pull Requests Commits

ErikKaum committed 1 year ago

ab2ab2a0

ErikKaum committed 1 year ago

05a1d1b8

delete release decorator

ErikKaum committed 1 year ago

82d79147

Update server/text_generation_server/utils/logits_process.py

ErikKaum committed 1 year ago

Verified 82240bf4

pre-commit again

ErikKaum committed 1 year ago

0ba10078

ErikKaum committed 1 year ago

f5a6691d

add param in healthcheck

ErikKaum committed 1 year ago

98e790e3

draft of unit integration test

ErikKaum committed 1 year ago

7186ab8e

add missed commit

Nathan Brake committed 1 year ago

54b45be3

run update docs

ErikKaum committed 1 year ago

d8d3c467

fix pre-commit checks

ErikKaum committed 1 year ago

72cade84

delete the last no repeat processor from warpers

ErikKaum committed 1 year ago

f6324ffb

satisfy compiler

ErikKaum committed 1 year ago

6353e241

make nrns optional

Nathan Brake committed 1 year ago

d0eef2b5

Nathan Brake committed 1 year ago

10b94055

Add support for no_repeat_ngram_size

Nathan Brake committed 1 year ago

ea915ad7

refactor usage stats (#2339)

ErikKaum committed 1 year ago

Verified 7451041e

Pr 2290 ci run (#2329)

drbh committed 1 year ago

Verified f7f61876

Handle GPTQ-Marlin loading in `GPTQMarlinWeightLoader` (#2300)

danieldk committed 1 year ago

Verified 34f7dcfd

Rebase TRT-llm (#2331)

Narsil committed 1 year ago

Verified 2b19d671

server quantize: store quantizer config in standard format (#2299)

danieldk committed 1 year ago

Verified 53aec273

fix: adjust test snapshots and small refactors (#2323)

drbh committed 1 year ago

Verified 0b95693f

patch-error-on-invalid-grammar (#2282)

ErikKaum committed 1 year ago

Verified 3d7f4f41

fix: reject grammars without properties (#2309)

drbh committed 1 year ago

Verified f15e808d

Install Marlin from standalone package (#2320)

danieldk committed 1 year ago

Verified 922732b2

Run ci api key (#2315)

ErikKaum committed 1 year ago

Verified 583d37a2

fix: fix buildkit config in ci

XciD committed 1 year ago

Verified fd2e0631

feat: add ruff and resolve issue (#2262)

drbh committed 1 year ago

Verified bab02ff2

Support tied embeddings in 0.5B and 1.5B Qwen2 models (#2313)

danieldk committed 1 year ago

Verified 4b49c50f

Fix registry name (#2307)

XciD committed 1 year ago

Verified 3905f854

Older