huggingface/text-generation-inference

Pull Requests Commits

mht-sharma committed 1 year ago

bfcc1df9

add updated makefile

mht-sharma committed 1 year ago

23c7d11c

update dockerfile

mht-sharma committed 1 year ago

c553a9cd

Torch 2.6 (#3134)

Narsil committed 1 year ago

Verified 54d15462

CI: enable server tests for backends (#3128)

baptistecolle committed 1 year ago

Verified 2e60a8dd

configurable termination timeout (#3126)

ErikKaum committed 1 year ago

Verified e5503eba

Minor fixes. (#3125)

Narsil committed 1 year ago

Verified e497bc09

Intel docker. (#3121)

Narsil committed 1 year ago

Verified 67ce543e

Prepare for patch release. (#3124)

Narsil committed 1 year ago

Verified 83fe45c1

Publish nix docker image. (#3122)

Narsil committed 1 year ago

Verified 11f2eec1

Bug Fix: Sliding Window Attention (#3112)

mht-sharma committed 1 year ago

Verified a35fbdb9

Gaudi: Sync TGI with the latest changes from the TGI-Gaudi fork (#3117)

baptistecolle committed 1 year ago

Verified 8c2c348f

launcher: correctly get the head dimension for VLMs (#3116)

danieldk committed 1 year ago

Verified 095775e0

xpu 2.6 update (#3051)

sywangyi committed 1 year ago

Verified 0b3e3db0

Make the Nix-based Docker container work on non-NixOS (#3109)

danieldk committed 1 year ago

Verified f91434e9

Fixing the docker build. (#3108)

Narsil committed 1 year ago

Verified 8b91f929

Release of Gaudi Backend for TGI (#3091)

baptistecolle committed 1 year ago

Verified 27ed8486

We need gcc during runtime to enable triton to compile kernels. (#3103)

Narsil committed 1 year ago

Verified 83ef3641

Router: add `gemma3-text` model type (#3107)

danieldk committed 1 year ago

Verified 83b7b7bb

Update to `kernels` 0.2.1 (#3084)

danieldk committed 1 year ago

Verified c73ae0bd

Try to fix on main CI color. (#3101)

Narsil committed 1 year ago

Verified d4c6faa6

Preparing relase 3.2.0 (#3100)

Narsil committed 1 year ago

Verified 4ac06ddf

Update neuron backend (#3098)

dacorvo committed 1 year ago

Verified f01dc9e7

Fix tool call4 (#3094)

Narsil committed 1 year ago

Verified 5c5528e3

Add gemma3 model (#3099)

mht-sharma committed 1 year ago

Verified ed46c2c4

Fix tool call3 (#3086)

Narsil committed 1 year ago

Verified f74c36fe

Update README.md (#3095)

celsowm committed 1 year ago

Verified ae4451c3

Fix qwen vl (#3096)

Narsil committed 1 year ago

Verified b447f7e8

Update the llamacpp backend (#3022)

angt committed 1 year ago

Verified 094975c3

Pr 3003 ci branch (#3007)

drbh committed 1 year ago

Verified dc5f05f8

Older