huggingface/text-generation-inference

Pull Requests Commits

fix: bump prompt

drbh committed 1 year ago

09631bc8

fix: update expected output from town to village

drbh committed 1 year ago

38b06b90

Use kernels from the kernel hub (#2988)

danieldk committed 1 year ago

Verified 571ac9b5

Updating mllama after strftime. (#2993)

Narsil committed 1 year ago

Verified 4b8cda68

[Backend] Bump TRTLLM to v.0.17.0 (#2991)

mfuntowicz committed 1 year ago

Verified 856709d5

Triton fix (#2995)

sywangyi committed 1 year ago

Verified 36223f83

Using the "lockfile". (#2992)

Narsil committed 1 year ago

Verified 0ef8c8a9

Improve qwen vl impl (#2943)

drbh committed 1 year ago

Verified c1cf36c0

impureWithCuda: fix gcc version (#2990)

danieldk committed 1 year ago

Verified dd2bd5fd

Add `strftime_now` callable function for `minijinja` chat templates (#2983)

alvarobartt committed 1 year ago

Verified 88fd56f5

hotfix: fix trtllm CI build on release (#2981)

Hugoch committed 1 year ago

Verified e3f2018c

Back on nix main. (#2979)

Narsil committed 1 year ago

Verified bb69c5b1

Prepare for release 3.1.0 (#2972)

Narsil committed 1 year ago

Verified c9d68945

Update moe-kernel to 0.8.2 for rocm (#2977)

mht-sharma committed 1 year ago

Verified c07a2cc8

doc: Update TRTLLM deployment doc. (#2960)

Hugoch committed 1 year ago

Verified 065aabb1

Add deepseekv3 (#2968)

Narsil committed 1 year ago

Verified cb747b33

Hotfixing intel-cpu (not sure how it was working before). (#2967)

Narsil committed 1 year ago

Verified 80e7d98f

Update to moe-kernels 0.8.0 (#2966)

danieldk committed 1 year ago

Verified ee0dffcd

Add fp8 support moe models (#2928)

mht-sharma committed 1 year ago

Verified 4ef2e045

Add backend name to telemetry (#2962)

Hugoch committed 1 year ago

Verified 73b7cf83

Fixing the oom maybe with 2.5.1 change. (#2958)

Narsil committed 1 year ago

Verified eb3df0f4

fix: Telemetry (#2957)

Hugoch committed 1 year ago

Verified c690da59

Update to attention-kernels 0.2.0 (#2950)

danieldk committed 1 year ago

Verified db922eb7

Attempt to remove AWS S3 flaky cache for sccache (#2953)

mfuntowicz committed 1 year ago

Verified 40b00275

Revert "Remove AWS credentials?"

Narsil committed 1 year ago

Verified 6cb41a80

Remove AWS credentials?

Narsil committed 1 year ago

Verified d2ff68e9

Trying to put back the archlist (to fix the oom). (#2947)

Narsil committed 1 year ago

Verified d9dda117

Fixing cargo lock.

Narsil committed 1 year ago

Verified d937eb64

Transformers backend TP fix (#2945)

Cyrilvallez committed 1 year ago

Verified 18c4607d

Tmp tp transformers (#2942)

Narsil committed 1 year ago

Verified 29a0893b

Older