huggingface/text-generation-inference

Pull Requests Commits

fix: bump ci build yaml

drbh committed 326 days ago

95d11723

feat: add neuron case to build ci

drbh committed 326 days ago

252f5468

feat(neuron): add server and integration tests

dacorvo committed 332 days ago

856d7682

feat(neuron): add server standalone installation

dacorvo committed 332 days ago

337329ff

feat: add neuron backend

dacorvo committed 332 days ago

9c25afb8

fix Qwen VL break in intel platform (#3002)

sywangyi committed 332 days ago

Verified 76bcb494

Revert "Update the flaky mllama test."

Narsil committed 332 days ago

Verified b86c3947

Update the flaky mllama test.

Narsil committed 332 days ago

Verified 8a870b31

Use kernels from the kernel hub (#2988)

danieldk committed 333 days ago

Verified 571ac9b5

Updating mllama after strftime. (#2993)

Narsil committed 337 days ago

Verified 4b8cda68

[Backend] Bump TRTLLM to v.0.17.0 (#2991)

mfuntowicz committed 337 days ago

Verified 856709d5

Triton fix (#2995)

sywangyi committed 338 days ago

Verified 36223f83

Using the "lockfile". (#2992)

Narsil committed 338 days ago

Verified 0ef8c8a9

Improve qwen vl impl (#2943)

drbh committed 339 days ago

Verified c1cf36c0

impureWithCuda: fix gcc version (#2990)

danieldk committed 339 days ago

Verified dd2bd5fd

Add `strftime_now` callable function for `minijinja` chat templates (#2983)

alvarobartt committed 340 days ago

Verified 88fd56f5

hotfix: fix trtllm CI build on release (#2981)

Hugoch committed 341 days ago

Verified e3f2018c

Back on nix main. (#2979)

Narsil committed 344 days ago

Verified bb69c5b1

Prepare for release 3.1.0 (#2972)

Narsil committed 344 days ago

Verified c9d68945

Update moe-kernel to 0.8.2 for rocm (#2977)

mht-sharma committed 344 days ago

Verified c07a2cc8

doc: Update TRTLLM deployment doc. (#2960)

Hugoch committed 344 days ago

Verified 065aabb1

Add deepseekv3 (#2968)

Narsil committed 344 days ago

Verified cb747b33

Hotfixing intel-cpu (not sure how it was working before). (#2967)

Narsil committed 345 days ago

Verified 80e7d98f

Update to moe-kernels 0.8.0 (#2966)

danieldk committed 345 days ago

Verified ee0dffcd

Add fp8 support moe models (#2928)

mht-sharma committed 346 days ago

Verified 4ef2e045

Add backend name to telemetry (#2962)

Hugoch committed 346 days ago

Verified 73b7cf83

Fixing the oom maybe with 2.5.1 change. (#2958)

Narsil committed 347 days ago

Verified eb3df0f4

fix: Telemetry (#2957)

Hugoch committed 347 days ago

Verified c690da59

Update to attention-kernels 0.2.0 (#2950)

danieldk committed 348 days ago

Verified db922eb7

Attempt to remove AWS S3 flaky cache for sccache (#2953)

mfuntowicz committed 348 days ago

Verified 40b00275

Older