huggingface/text-generation-inference

Pull Requests Commits

fix: install hf cli before upload

drbh committed 1 year ago

1bf32d97

feat: upload assets to hub rather than github

drbh committed 1 year ago

dab44ac1

fix: set cuda arch list prior to vllm build

drbh committed 1 year ago

da1a0b34

feat: compile vllm for cuda after flash_attn

drbh committed 1 year ago

ad94f299

fix: build kernels inside of repo and move to single dist

drbh committed 1 year ago

8253f830

feat: cache wheel as build artifact

drbh committed 1 year ago

ec8c638d

fix: adjust skip build typo

drbh committed 1 year ago

7765aa6e

fix: build proto in CI and avoid rate limit in client test

drbh committed 1 year ago

814e07df

fix: adjust upload command

drbh committed 1 year ago

2ee4b9f7

fix: skip redundant login

drbh committed 1 year ago

47e19377

feat: upload single pre compile to hub

drbh committed 1 year ago

01e68b5a

fix: list nested dist in workflow

drbh committed 1 year ago

49c12244

fix: debug cwd after build

drbh committed 1 year ago

7aebbd2e

fix: move to parent dir after wheel build

drbh committed 1 year ago

a4cd4030

fix: limit build and tweak post build commands

drbh committed 1 year ago

f4e7cdb0

fix: avoid setup_release job

drbh committed 1 year ago

816e14f0

fix: adjust workflow condition

drbh committed 1 year ago

15fa236b

feat: add workflow to build flash_attn

drbh committed 1 year ago

7d1651f4

fix: avoid library name collision and add core deps to build

drbh committed 1 year ago

38688ba4

fix: exclude tgi from workspace and improve build

drbh committed 1 year ago

70b27c4b

feat: bundle launcher and refactor cli wrappers

drbh committed 1 year ago

30f4deba

feat: package text-generation-server with tgi library

drbh committed 1 year ago

af2b2e83

fix: add missing imports post rebase

drbh committed 1 year ago

72d69071

feat: experimental python packaging and interface

drbh committed 1 year ago

0e5220d7

Fixing the text part from tokenizer endpoint. (#1967)

Narsil committed 1 year ago

Verified 612bc483

Fix (non-container) pytest stdout buffering-related lock-up

danieldk committed 1 year ago

f20463e4

Upgrade to Axum 0.7 and Hyper 1.0 (Breaking change: disabled ngrok tunneling). (#1959)

Narsil committed 1 year ago

Verified e76b9824

fix small typo and broken link (#1958)

MoritzLaurer committed 1 year ago

Verified b7ffa287

Processor config chat template (#1954)

drbh committed 1 year ago

Verified 0732b9d2

Fix GPTQ for models which do not have float16 at the default dtype (simpler) (#1953)

danieldk committed 1 year ago

Verified a401c83c

Older