huggingface/text-generation-inference

Pull Requests Commits

fix post refactor

fxmarty committed 2 years ago

2967b816

Merge branch 'main' into ci_amd3

fxmarty committed 2 years ago

291453fe

Remove stray `quantize` argument in `get_weights_col_packed_qkv` (#2237)

danieldk committed 2 years ago

Verified da82c63a

`server quantize`: expose groupsize option (#2225)

danieldk committed 2 years ago

Verified 2cb18428

Add support for AWQ-quantized Idefics2 (#2233)

danieldk committed 2 years ago

Verified 06d0e880

fix: Remove bitsandbytes installation when running cpu-only install (#2216)

Hugoch committed 2 years ago

Verified 0ad7f6f8

fix custom cache dir (#2226)

ErikKaum committed 2 years ago

Verified 457fb0a1

feat: simple mistral lora integration tests (#2180)

drbh committed 2 years ago

Verified 5a650669

Use symmetric quantization in the `quantize` subcommand (#2120)

danieldk committed 2 years ago

Verified dbb23fbf

[fix] Modifying base in yarn embedding (#2212)

SeongBeomLEE committed 2 years ago

Verified c46eaf70

fix: append DONE message to chat stream (#2221)

drbh committed 2 years ago

Verified d789de32

Add support for FP8 on compute capability >=8.0, <8.9 (#2213)

danieldk committed 2 years ago

Verified cb150eb2

Move quantized weight handling out of the `Weights` class (#2194)

danieldk committed 2 years ago

Verified 8511669c

Updating the self check (#2209)

Narsil committed 2 years ago

Verified 4c976fb4

Fixed README ToC (#2196)

vinkamath committed 2 years ago

Verified f5ba9bfd

Adding sanity check to openapi docs.

Narsil committed 2 years ago

Verified fe710af2

Fix buildx cache + change runner type (#2176)

glegendre01 committed 2 years ago

Verified 5e2a3058

Fix nccl regression on PyTorch 2.3 upgrade (#2099)

fxmarty committed 2 years ago

Verified 4c50b6d0

feat: use model name as adapter id in chat endpoints (#2128)

drbh committed 2 years ago

Verified 87ebb647

update to metrics 0.23.0 or could work with metrics-exporter-promethe… (#2190)

sywangyi committed 2 years ago

Verified 58effe78

fix: python deserialization (#2178)

jaluma committed 2 years ago

Verified 16d9e505

add doc for intel gpus (#2181)

sywangyi committed 2 years ago

Verified 07e240ca

fxmarty committed 2 years ago

d7c60613

Falcon/DBRX: get correct number of key-value heads (#2205)

danieldk committed 2 years ago

Verified 5c7c9f13

use base docker image

fxmarty committed 2 years ago

4e3f6874

Merge branch 'main' into ci_amd3

fxmarty committed 2 years ago

8c590be4

Fix incorrect cache allocation with multi-query (#2203)

danieldk committed 2 years ago

Verified 153fcf77

hotfix: Fix number of KV heads (#2202)

danieldk committed 2 years ago

Verified cce475a9

fix dbrx & opt model prefix bug (#2201)

icyxp committed 2 years ago

Verified 521d0d99

Consistently take `prefix` in model constructors (#2191)

danieldk committed 2 years ago

Verified 05c094fc

Older