huggingface/text-generation-inference

Pull Requests Commits

increase timeouts

ErikKaum committed 1 year ago

e0535a13

fix: bump org name in gemma3 test

drbh committed 1 year ago

febc488e

fix: add pillow dependency and bump lock+requirements

drbh committed 1 year ago

2c2fc654

Upgrading `from_env` to get token from file when necessary + fix

Narsil committed 1 year ago

Verified e5dfd41e

feat: add tests for image types and remove alpha from png

drbh committed 1 year ago

659ce4f3

fix: bump snapshots and improve exceed window test case

drbh committed 1 year ago

e5ec176b

Update window size rocm flash decoding

mht-sharma committed 1 year ago

170a12f3

Add window_size_left param ipex rocm

mht-sharma committed 1 year ago

b30cdabf

(typo) collection link

mht-sharma committed 1 year ago

eaf18c1c

(fix) flashinfer

mht-sharma committed 1 year ago

69e0a87d

(fix) sliding window attention

mht-sharma committed 1 year ago

ff82f0f8

Make the Nix-based Docker container work on non-NixOS (#3109)

danieldk committed 1 year ago

Verified f91434e9

Fixing the docker build. (#3108)

Narsil committed 1 year ago

Verified 8b91f929

Release of Gaudi Backend for TGI (#3091)

baptistecolle committed 1 year ago

Verified 27ed8486

We need gcc during runtime to enable triton to compile kernels. (#3103)

Narsil committed 1 year ago

Verified 83ef3641

Router: add `gemma3-text` model type (#3107)

danieldk committed 1 year ago

Verified 83b7b7bb

Update to `kernels` 0.2.1 (#3084)

danieldk committed 1 year ago

Verified c73ae0bd

Try to fix on main CI color. (#3101)

Narsil committed 1 year ago

Verified d4c6faa6

Preparing relase 3.2.0 (#3100)

Narsil committed 1 year ago

Verified 4ac06ddf

Update neuron backend (#3098)

dacorvo committed 1 year ago

Verified f01dc9e7

Fix tool call4 (#3094)

Narsil committed 1 year ago

Verified 5c5528e3

Add gemma3 model (#3099)

mht-sharma committed 1 year ago

Verified ed46c2c4

Fix tool call3 (#3086)

Narsil committed 1 year ago

Verified f74c36fe

Update README.md (#3095)

celsowm committed 1 year ago

Verified ae4451c3

Fix qwen vl (#3096)

Narsil committed 1 year ago

Verified b447f7e8

Update the llamacpp backend (#3022)

angt committed 1 year ago

Verified 094975c3

Pr 3003 ci branch (#3007)

drbh committed 1 year ago

Verified dc5f05f8

hotfix: qwen2 formatting (#3093)

danieldk committed 1 year ago

Verified 124398fa

Small test and typing fixes (#3078)

danieldk committed 1 year ago

Verified c5ecc7a4

Add modules_to_not_convert in quantized model (#3053)

jiqing-feng committed 1 year ago

Verified cae0cbe8

Older