huggingface/text-generation-inference

Pull Requests Commits

remove tr version

mht-sharma committed 346 days ago

53567b00

remove redundant changes

mht-sharma committed 347 days ago

04aab711

mht-sharma committed 347 days ago

8094de91

Add cache position

mht-sharma committed 349 days ago

7a57b010

mht-sharma committed 350 days ago

22aaf497

fixes and improvements

mht-sharma committed 350 days ago

cc0552f8

mht-sharma committed 351 days ago

8e01191b

mht-sharma committed 351 days ago

06663162

Add comments for support of models

mht-sharma committed 362 days ago

b5bac0dd

Improve attn_implementation

mht-sharma committed 362 days ago

50ffe00a

cleanup comment

mht-sharma committed 362 days ago

b41faae3

Add support for other vlm

mht-sharma committed 362 days ago

ac6fc70c

initial changes

mht-sharma committed 363 days ago

d8d09f9c

Minor fixes. (#3125)

Narsil committed 1 year ago

Verified e497bc09

Intel docker. (#3121)

Narsil committed 1 year ago

Verified 67ce543e

Prepare for patch release. (#3124)

Narsil committed 1 year ago

Verified 83fe45c1

Publish nix docker image. (#3122)

Narsil committed 1 year ago

Verified 11f2eec1

Bug Fix: Sliding Window Attention (#3112)

mht-sharma committed 1 year ago

Verified a35fbdb9

Gaudi: Sync TGI with the latest changes from the TGI-Gaudi fork (#3117)

baptistecolle committed 1 year ago

Verified 8c2c348f

launcher: correctly get the head dimension for VLMs (#3116)

danieldk committed 1 year ago

Verified 095775e0

xpu 2.6 update (#3051)

sywangyi committed 1 year ago

Verified 0b3e3db0

Make the Nix-based Docker container work on non-NixOS (#3109)

danieldk committed 1 year ago

Verified f91434e9

Fixing the docker build. (#3108)

Narsil committed 1 year ago

Verified 8b91f929

Release of Gaudi Backend for TGI (#3091)

baptistecolle committed 1 year ago

Verified 27ed8486

We need gcc during runtime to enable triton to compile kernels. (#3103)

Narsil committed 1 year ago

Verified 83ef3641

Router: add `gemma3-text` model type (#3107)

danieldk committed 1 year ago

Verified 83b7b7bb

Update to `kernels` 0.2.1 (#3084)

danieldk committed 1 year ago

Verified c73ae0bd

Try to fix on main CI color. (#3101)

Narsil committed 1 year ago

Verified d4c6faa6

Preparing relase 3.2.0 (#3100)

Narsil committed 1 year ago

Verified 4ac06ddf

Update neuron backend (#3098)

dacorvo committed 1 year ago

Verified f01dc9e7

Older