huggingface/text-generation-inference

Pull Requests Commits

fix: bump prompt

drbh committed 309 days ago

09631bc8

fix: update expected output from town to village

drbh committed 309 days ago

38b06b90

Use kernels from the kernel hub (#2988)

danieldk committed 310 days ago

Verified 571ac9b5

Updating mllama after strftime. (#2993)

Narsil committed 313 days ago

Verified 4b8cda68

[Backend] Bump TRTLLM to v.0.17.0 (#2991)

mfuntowicz committed 314 days ago

Verified 856709d5

Triton fix (#2995)

sywangyi committed 314 days ago

Verified 36223f83

Using the "lockfile". (#2992)

Narsil committed 314 days ago

Verified 0ef8c8a9

Improve qwen vl impl (#2943)

drbh committed 316 days ago

Verified c1cf36c0

impureWithCuda: fix gcc version (#2990)

danieldk committed 316 days ago

Verified dd2bd5fd

Add `strftime_now` callable function for `minijinja` chat templates (#2983)

alvarobartt committed 317 days ago

Verified 88fd56f5

hotfix: fix trtllm CI build on release (#2981)

Hugoch committed 317 days ago

Verified e3f2018c

Back on nix main. (#2979)

Narsil committed 320 days ago

Verified bb69c5b1

Prepare for release 3.1.0 (#2972)

Narsil committed 320 days ago

Verified c9d68945

Update moe-kernel to 0.8.2 for rocm (#2977)

mht-sharma committed 320 days ago

Verified c07a2cc8

doc: Update TRTLLM deployment doc. (#2960)

Hugoch committed 321 days ago

Verified 065aabb1

Add deepseekv3 (#2968)

Narsil committed 321 days ago

Verified cb747b33

Hotfixing intel-cpu (not sure how it was working before). (#2967)

Narsil committed 322 days ago

Verified 80e7d98f

Update to moe-kernels 0.8.0 (#2966)

danieldk committed 322 days ago

Verified ee0dffcd

Add fp8 support moe models (#2928)

mht-sharma committed 322 days ago

Verified 4ef2e045

Add backend name to telemetry (#2962)

Hugoch committed 323 days ago

Verified 73b7cf83

Fixing the oom maybe with 2.5.1 change. (#2958)

Narsil committed 323 days ago

Verified eb3df0f4

fix: Telemetry (#2957)

Hugoch committed 323 days ago

Verified c690da59

Update to attention-kernels 0.2.0 (#2950)

danieldk committed 324 days ago

Verified db922eb7

Attempt to remove AWS S3 flaky cache for sccache (#2953)

mfuntowicz committed 324 days ago

Verified 40b00275

Revert "Remove AWS credentials?"

Narsil committed 327 days ago

Verified 6cb41a80

Remove AWS credentials?

Narsil committed 327 days ago

Verified d2ff68e9

Trying to put back the archlist (to fix the oom). (#2947)

Narsil committed 327 days ago

Verified d9dda117

Fixing cargo lock.

Narsil committed 328 days ago

Verified d937eb64

Transformers backend TP fix (#2945)

Cyrilvallez committed 328 days ago

Verified 18c4607d

Tmp tp transformers (#2942)

Narsil committed 328 days ago

Verified 29a0893b

Older