huggingface/text-generation-inference

Pull Requests Commits

fix: bump ci build yaml

drbh committed 352 days ago

95d11723

feat: add neuron case to build ci

drbh committed 352 days ago

252f5468

feat(neuron): add server and integration tests

dacorvo committed 358 days ago

856d7682

feat(neuron): add server standalone installation

dacorvo committed 358 days ago

337329ff

feat: add neuron backend

dacorvo committed 358 days ago

9c25afb8

fix Qwen VL break in intel platform (#3002)

sywangyi committed 358 days ago

Verified 76bcb494

Revert "Update the flaky mllama test."

Narsil committed 358 days ago

Verified b86c3947

Update the flaky mllama test.

Narsil committed 358 days ago

Verified 8a870b31

Use kernels from the kernel hub (#2988)

danieldk committed 359 days ago

Verified 571ac9b5

Updating mllama after strftime. (#2993)

Narsil committed 363 days ago

Verified 4b8cda68

[Backend] Bump TRTLLM to v.0.17.0 (#2991)

mfuntowicz committed 363 days ago

Verified 856709d5

Triton fix (#2995)

sywangyi committed 364 days ago

Verified 36223f83

Using the "lockfile". (#2992)

Narsil committed 364 days ago

Verified 0ef8c8a9

Improve qwen vl impl (#2943)

drbh committed 1 year ago

Verified c1cf36c0

impureWithCuda: fix gcc version (#2990)

danieldk committed 1 year ago

Verified dd2bd5fd

Add `strftime_now` callable function for `minijinja` chat templates (#2983)

alvarobartt committed 1 year ago

Verified 88fd56f5

hotfix: fix trtllm CI build on release (#2981)

Hugoch committed 1 year ago

Verified e3f2018c

Back on nix main. (#2979)

Narsil committed 1 year ago

Verified bb69c5b1

Prepare for release 3.1.0 (#2972)

Narsil committed 1 year ago

Verified c9d68945

Update moe-kernel to 0.8.2 for rocm (#2977)

mht-sharma committed 1 year ago

Verified c07a2cc8

doc: Update TRTLLM deployment doc. (#2960)

Hugoch committed 1 year ago

Verified 065aabb1

Add deepseekv3 (#2968)

Narsil committed 1 year ago

Verified cb747b33

Hotfixing intel-cpu (not sure how it was working before). (#2967)

Narsil committed 1 year ago

Verified 80e7d98f

Update to moe-kernels 0.8.0 (#2966)

danieldk committed 1 year ago

Verified ee0dffcd

Add fp8 support moe models (#2928)

mht-sharma committed 1 year ago

Verified 4ef2e045

Add backend name to telemetry (#2962)

Hugoch committed 1 year ago

Verified 73b7cf83

Fixing the oom maybe with 2.5.1 change. (#2958)

Narsil committed 1 year ago

Verified eb3df0f4

fix: Telemetry (#2957)

Hugoch committed 1 year ago

Verified c690da59

Update to attention-kernels 0.2.0 (#2950)

danieldk committed 1 year ago

Verified db922eb7

Attempt to remove AWS S3 flaky cache for sccache (#2953)

mfuntowicz committed 1 year ago

Verified 40b00275

Older