huggingface/text-generation-inference

Pull Requests Commits

feat: allow model load and stub logits

drbh committed 1 year ago

69936732

Minor fixes. (#3125)

Narsil committed 1 year ago

Verified e497bc09

Intel docker. (#3121)

Narsil committed 1 year ago

Verified 67ce543e

Prepare for patch release. (#3124)

Narsil committed 1 year ago

Verified 83fe45c1

Publish nix docker image. (#3122)

Narsil committed 1 year ago

Verified 11f2eec1

Bug Fix: Sliding Window Attention (#3112)

mht-sharma committed 1 year ago

Verified a35fbdb9

Gaudi: Sync TGI with the latest changes from the TGI-Gaudi fork (#3117)

baptistecolle committed 1 year ago

Verified 8c2c348f

launcher: correctly get the head dimension for VLMs (#3116)

danieldk committed 1 year ago

Verified 095775e0

xpu 2.6 update (#3051)

sywangyi committed 1 year ago

Verified 0b3e3db0

Make the Nix-based Docker container work on non-NixOS (#3109)

danieldk committed 1 year ago

Verified f91434e9

Fixing the docker build. (#3108)

Narsil committed 1 year ago

Verified 8b91f929

Release of Gaudi Backend for TGI (#3091)

baptistecolle committed 1 year ago

Verified 27ed8486

We need gcc during runtime to enable triton to compile kernels. (#3103)

Narsil committed 1 year ago

Verified 83ef3641

Router: add `gemma3-text` model type (#3107)

danieldk committed 1 year ago

Verified 83b7b7bb

Update to `kernels` 0.2.1 (#3084)

danieldk committed 1 year ago

Verified c73ae0bd

Try to fix on main CI color. (#3101)

Narsil committed 1 year ago

Verified d4c6faa6

Preparing relase 3.2.0 (#3100)

Narsil committed 1 year ago

Verified 4ac06ddf

Update neuron backend (#3098)

dacorvo committed 1 year ago

Verified f01dc9e7

Fix tool call4 (#3094)

Narsil committed 1 year ago

Verified 5c5528e3

Add gemma3 model (#3099)

mht-sharma committed 1 year ago

Verified ed46c2c4

Fix tool call3 (#3086)

Narsil committed 1 year ago

Verified f74c36fe

Update README.md (#3095)

celsowm committed 1 year ago

Verified ae4451c3

Fix qwen vl (#3096)

Narsil committed 1 year ago

Verified b447f7e8

Update the llamacpp backend (#3022)

angt committed 1 year ago

Verified 094975c3

Pr 3003 ci branch (#3007)

drbh committed 1 year ago

Verified dc5f05f8

hotfix: qwen2 formatting (#3093)

danieldk committed 1 year ago

Verified 124398fa

Small test and typing fixes (#3078)

danieldk committed 1 year ago

Verified c5ecc7a4

Add modules_to_not_convert in quantized model (#3053)

jiqing-feng committed 1 year ago

Verified cae0cbe8

Add qwen2 multi lora layers support (#3089)

EachSheep committed 1 year ago

Verified bbe218a4

Add request parameters to OTel span for `/v1/chat/completions` endpoint (#3000)

aW3st committed 1 year ago

Verified 58a65f79

Older