huggingface/text-generation-inference

Pull Requests Commits

All the assertions.

Narsil committed 340 days ago

Verified ddf0b022

Update version number.

Narsil committed 1 year ago

Verified 463228eb

Prepare for release 3.1.0 (#2972)

Narsil committed 1 year ago

Verified c9d68945

Update moe-kernel to 0.8.2 for rocm (#2977)

mht-sharma committed 1 year ago

Verified c07a2cc8

doc: Update TRTLLM deployment doc. (#2960)

Hugoch committed 1 year ago

Verified 065aabb1

Add deepseekv3 (#2968)

Narsil committed 1 year ago

Verified cb747b33

Hotfixing intel-cpu (not sure how it was working before). (#2967)

Narsil committed 1 year ago

Verified 80e7d98f

Update to moe-kernels 0.8.0 (#2966)

danieldk committed 1 year ago

Verified ee0dffcd

Add fp8 support moe models (#2928)

mht-sharma committed 1 year ago

Verified 4ef2e045

Add backend name to telemetry (#2962)

Hugoch committed 1 year ago

Verified 73b7cf83

Fixing the oom maybe with 2.5.1 change. (#2958)

Narsil committed 1 year ago

Verified eb3df0f4

fix: Telemetry (#2957)

Hugoch committed 1 year ago

Verified c690da59

Update to attention-kernels 0.2.0 (#2950)

danieldk committed 1 year ago

Verified db922eb7

Attempt to remove AWS S3 flaky cache for sccache (#2953)

mfuntowicz committed 1 year ago

Verified 40b00275

Revert "Remove AWS credentials?"

Narsil committed 1 year ago

Verified 6cb41a80

Remove AWS credentials?

Narsil committed 1 year ago

Verified d2ff68e9

Trying to put back the archlist (to fix the oom). (#2947)

Narsil committed 1 year ago

Verified d9dda117

Fixing cargo lock.

Narsil committed 1 year ago

Verified d937eb64

Transformers backend TP fix (#2945)

Cyrilvallez committed 1 year ago

Verified 18c4607d

Tmp tp transformers (#2942)

Narsil committed 1 year ago

Verified 29a0893b

[TRTLLM] Expose finish reason (#2841)

mfuntowicz committed 1 year ago

Verified 0a899026

Add NVIDIA A40 to known cards (#2941)

kldzj committed 1 year ago

Verified 4e172028

Set `alias` for `max_completion_tokens` in `ChatRequest` (#2932)

alvarobartt committed 1 year ago

Verified 6ab02931

Bump TensorRT-LLM backend dependency to v0.16.0 (#2931)

mfuntowicz committed 1 year ago

Verified cc212154

Clarify FP8-Marlin use on capability 8.9 (#2940)

danieldk committed 1 year ago

Verified 1dd34666

fix moe in quantization path (#2935)

sywangyi committed 1 year ago

Verified 1d3c9beb

Upgrading the deps to have transformers==4.48.0 necessary (#2937)

Narsil committed 1 year ago

Verified 2dfe3b3e

Run `pre-commit run --all-files` to fix CI (#2933)

alvarobartt committed 1 year ago

Verified 64a33c1f

Trying to avoid the random timeout. (#2929)

Narsil committed 1 year ago

Verified bdb3e488

Give TensorRT-LLMa proper CI/CD 😍 (#2886)

mfuntowicz committed 1 year ago

Verified 17367438

Older