huggingface/text-generation-inference

Pull Requests Commits

docs(conceptual/speculation): available links Train Medusa (#2863)

guspan-tanadi committed 338 days ago

Verified 3c7ae48f

Baichuan2-13B does not have max_position_embeddings in config (#2903)

sywangyi committed 338 days ago

Verified cc8b9650

Enable FP8 Per-Tensor Scales and Integrate Marlin/MoE Kernels Repo for ROCm (#2825)

mht-sharma committed 339 days ago

Verified e07acc7f

Add Flash decoding kernel ROCm (#2855)

mht-sharma committed 340 days ago

Verified 880ab9c2

fix crash in torch2.6 if TP=1 (#2885)

sywangyi committed 340 days ago

Verified 1660154a

Update using_guidance.md (#2901)

nbroad1881 committed 340 days ago

Verified 2e22164d

Add possible variants for A100 and H100 GPUs for auto-detecting flops (#2837)

lazariv committed 343 days ago

Verified 83624a07

chore: Update jsonschema to 0.28.0 (#2870)

Stranger6667 committed 343 days ago

Verified 01067f8b

Update to marlin-kernels 0.3.7 (#2882)

danieldk committed 343 days ago

Verified 4f7e00f4

Improve vlm support (add idefics3 support) (#2437)

drbh committed 344 days ago

Verified da5ab467

Basic flashinfer 0.2 support (#2862)

danieldk committed 344 days ago

Verified a9c7d2e3

update ipex xpu to fix issue in ARC770 (#2884)

sywangyi committed 344 days ago

Verified afb6c728

chore: fixed some typos and attribute issues in README (#2891)

ruidazeng committed 344 days ago

Verified d37a43e5

fix: include add_special_tokens in kserve request (#2859)

drbh committed 1 year ago

Verified 23bc38b1

change xpu lib download link (#2852)

sywangyi committed 1 year ago

Verified ab5f6169

Update vllm kernels for ROCM (#2826)

mht-sharma committed 1 year ago

Verified 8f66d323

Qwen2-VL runtime error fix when prompted with multiple images (#2840)

janne-alatalo committed 1 year ago

Verified 7eeefa3b

fix: lint backend and doc files (#2850)

drbh committed 1 year ago

Verified a72f339c

Fixing CI. (#2846)

Narsil committed 1 year ago

Verified 11ab3298

New arg. (#2845)

Narsil committed 1 year ago

Verified 6f0b8c94

Feat/trtllm cancellation dev container (#2795)

Hugoch committed 1 year ago

Verified 1708865f

TensorRT-LLM backend bump to latest version + misc fixes (#2791)

mfuntowicz committed 1 year ago

Verified ea7f4082

Fixup opt to reduce the amount of odd if statements. (#2833)

Narsil committed 1 year ago

Verified 3bb3fd19

fix facebook/opt-125m not working issue (#2824)

sywangyi committed 1 year ago

Verified bf59118a

Fixing latest flavor by disabling it. (#2831)

Narsil committed 1 year ago

Verified c3bd7212

docs(README): supported hardware links TGI AMD GPUs (#2814)

guspan-tanadi committed 1 year ago

Verified f01f2fb6

Prepare patch release. (#2829)

Narsil committed 1 year ago

Verified 07b01293

Update README.md (#2827)

RodriMora committed 1 year ago

Verified cc66dccb

Using both value from config as they might not be correct. (#2817)

Narsil committed 1 year ago

Verified 82c24f74

Small update to docs (#2816)

Narsil committed 1 year ago

Verified a2d878fa

Newer Older