huggingface/text-generation-inference

Pull Requests Commits

All the assertions.

Narsil committed 316 days ago

Verified ddf0b022

Update version number.

Narsil committed 348 days ago

Verified 463228eb

Prepare for release 3.1.0 (#2972)

Narsil committed 348 days ago

Verified c9d68945

Update moe-kernel to 0.8.2 for rocm (#2977)

mht-sharma committed 348 days ago

Verified c07a2cc8

doc: Update TRTLLM deployment doc. (#2960)

Hugoch committed 349 days ago

Verified 065aabb1

Add deepseekv3 (#2968)

Narsil committed 349 days ago

Verified cb747b33

Hotfixing intel-cpu (not sure how it was working before). (#2967)

Narsil committed 350 days ago

Verified 80e7d98f

Update to moe-kernels 0.8.0 (#2966)

danieldk committed 350 days ago

Verified ee0dffcd

Add fp8 support moe models (#2928)

mht-sharma committed 350 days ago

Verified 4ef2e045

Add backend name to telemetry (#2962)

Hugoch committed 351 days ago

Verified 73b7cf83

Fixing the oom maybe with 2.5.1 change. (#2958)

Narsil committed 351 days ago

Verified eb3df0f4

fix: Telemetry (#2957)

Hugoch committed 351 days ago

Verified c690da59

Update to attention-kernels 0.2.0 (#2950)

danieldk committed 352 days ago

Verified db922eb7

Attempt to remove AWS S3 flaky cache for sccache (#2953)

mfuntowicz committed 352 days ago

Verified 40b00275

Revert "Remove AWS credentials?"

Narsil committed 355 days ago

Verified 6cb41a80

Remove AWS credentials?

Narsil committed 355 days ago

Verified d2ff68e9

Trying to put back the archlist (to fix the oom). (#2947)

Narsil committed 355 days ago

Verified d9dda117

Fixing cargo lock.

Narsil committed 356 days ago

Verified d937eb64

Transformers backend TP fix (#2945)

Cyrilvallez committed 356 days ago

Verified 18c4607d

Tmp tp transformers (#2942)

Narsil committed 356 days ago

Verified 29a0893b

[TRTLLM] Expose finish reason (#2841)

mfuntowicz committed 356 days ago

Verified 0a899026

Add NVIDIA A40 to known cards (#2941)

kldzj committed 356 days ago

Verified 4e172028

Set `alias` for `max_completion_tokens` in `ChatRequest` (#2932)

alvarobartt committed 356 days ago

Verified 6ab02931

Bump TensorRT-LLM backend dependency to v0.16.0 (#2931)

mfuntowicz committed 356 days ago

Verified cc212154

Clarify FP8-Marlin use on capability 8.9 (#2940)

danieldk committed 357 days ago

Verified 1dd34666

fix moe in quantization path (#2935)

sywangyi committed 357 days ago

Verified 1d3c9beb

Upgrading the deps to have transformers==4.48.0 necessary (#2937)

Narsil committed 357 days ago

Verified 2dfe3b3e

Run `pre-commit run --all-files` to fix CI (#2933)

alvarobartt committed 358 days ago

Verified 64a33c1f

Trying to avoid the random timeout. (#2929)

Narsil committed 358 days ago

Verified bdb3e488

Give TensorRT-LLMa proper CI/CD 😍 (#2886)

mfuntowicz committed 358 days ago

Verified 17367438

Older