huggingface/text-generation-inference

Pull Requests Commits

fix(server): remove position_ids from galactica forward (#82)

OlivierDehaene committed 2 years ago

Verified 78063c05

feat(server): enable hf-transfer (#76)

OlivierDehaene committed 2 years ago

Verified 17bc841b

feat(router): add cors allow origin options (#73)

OlivierDehaene committed 2 years ago

Verified 6796d38c

OlivierDehaene committed 2 years ago

Verified c720555a

feat(router): add prometheus metrics scrape endpoint (#71)

OlivierDehaene committed 2 years ago

Verified 439fcaf8

fix(launcher): copy current env vars to subprocesses (#70)

OlivierDehaene committed 2 years ago

Verified 7b3d460d

feat(router): add max_total_tokens and empty_input validation (#68)

OlivierDehaene committed 2 years ago

Verified 5437d49b

feat(launcher): add disable_custom_kernels arg (#67)

OlivierDehaene committed 2 years ago

Verified 68455353

feat(server): improve download logging (#66)

OlivierDehaene committed 2 years ago

Verified c5a4a1fa

feat: add safetensors conversion (#63)

OlivierDehaene committed 2 years ago

Verified 0fbc6919

feat: add distributed tracing (#62)

OlivierDehaene committed 2 years ago

Verified 9af45414

fixed SSE naming (#61)

yk committed 2 years ago

Verified e520d5b3

fix(docker): increase shm size (#60)

OlivierDehaene committed 2 years ago

Verified 1ad3250b

feat(server): support t5 (#59)

OlivierDehaene committed 2 years ago

Verified c503a639

OlivierDehaene committed 2 years ago

Verified 2fe5e1b3

fix(server): better handling of inference mode (#57)

OlivierDehaene committed 2 years ago

Verified 4acc42a6

feat(ci): push to AML registry (#56)

OlivierDehaene committed 2 years ago

Verified e114d874

feat(docs): Clarify installation steps (#54)

lewtun committed 2 years ago

Verified a0dca443

feat(router): refactor API and add openAPI schemas (#53)

OlivierDehaene committed 2 years ago

Verified 20c3c594

breaking(router): modify /generate API to only return generated text (#50)

OlivierDehaene committed 2 years ago

Verified b1482d90

feat(router): use background task to manage request queue (#52)

OlivierDehaene committed 2 years ago

Verified 7b870e1e

fix(server): allow greedy repetition penalty (#51)

OlivierDehaene committed 2 years ago

Verified df227ac2

feat(server): allow the server to use a local weight cache (#49)

OlivierDehaene committed 2 years ago

Verified 775115e3

feat(server): support repetition penalty (#47)

OlivierDehaene committed 2 years ago

Verified 313194f6

feat(server): allow gpt-neox models with odd vocab sizes to be sharded (#48)

OlivierDehaene committed 2 years ago

Verified 2ad895a6

feat(ci): Docker build and push (#46)

OlivierDehaene committed 2 years ago

Verified 404ed7a1

feat(server): Support GPT-Neox (#39)

OlivierDehaene committed 2 years ago

Verified f830706b

fix(server): fix quantization for sharded models (#45)

OlivierDehaene committed 2 years ago

Verified c6e8b944

feat: Add token streaming using ServerSideEvents support (#41)

OlivierDehaene committed 2 years ago

Verified 017a2a8c

fix(server): fix seeding with multiple shards (#44)

OlivierDehaene committed 2 years ago

Verified 54fec931

Newer Older