huggingface/text-generation-inference

Pull Requests Commits

fix: bump ci build yaml

drbh committed 1 year ago

95d11723

feat: add neuron case to build ci

drbh committed 1 year ago

252f5468

feat(neuron): add server and integration tests

dacorvo committed 1 year ago

856d7682

feat(neuron): add server standalone installation

dacorvo committed 1 year ago

337329ff

feat: add neuron backend

dacorvo committed 1 year ago

9c25afb8

fix Qwen VL break in intel platform (#3002)

sywangyi committed 1 year ago

Verified 76bcb494

Revert "Update the flaky mllama test."

Narsil committed 1 year ago

Verified b86c3947

Update the flaky mllama test.

Narsil committed 1 year ago

Verified 8a870b31

Use kernels from the kernel hub (#2988)

danieldk committed 1 year ago

Verified 571ac9b5

Updating mllama after strftime. (#2993)

Narsil committed 1 year ago

Verified 4b8cda68

[Backend] Bump TRTLLM to v.0.17.0 (#2991)

mfuntowicz committed 1 year ago

Verified 856709d5

Triton fix (#2995)

sywangyi committed 1 year ago

Verified 36223f83

Using the "lockfile". (#2992)

Narsil committed 1 year ago

Verified 0ef8c8a9

Improve qwen vl impl (#2943)

drbh committed 1 year ago

Verified c1cf36c0

impureWithCuda: fix gcc version (#2990)

danieldk committed 1 year ago

Verified dd2bd5fd

Add `strftime_now` callable function for `minijinja` chat templates (#2983)

alvarobartt committed 1 year ago

Verified 88fd56f5

hotfix: fix trtllm CI build on release (#2981)

Hugoch committed 1 year ago

Verified e3f2018c

Back on nix main. (#2979)

Narsil committed 1 year ago

Verified bb69c5b1

Prepare for release 3.1.0 (#2972)

Narsil committed 1 year ago

Verified c9d68945

Update moe-kernel to 0.8.2 for rocm (#2977)

mht-sharma committed 1 year ago

Verified c07a2cc8

doc: Update TRTLLM deployment doc. (#2960)

Hugoch committed 1 year ago

Verified 065aabb1

Add deepseekv3 (#2968)

Narsil committed 1 year ago

Verified cb747b33

Hotfixing intel-cpu (not sure how it was working before). (#2967)

Narsil committed 1 year ago

Verified 80e7d98f

Update to moe-kernels 0.8.0 (#2966)

danieldk committed 1 year ago

Verified ee0dffcd

Add fp8 support moe models (#2928)

mht-sharma committed 1 year ago

Verified 4ef2e045

Add backend name to telemetry (#2962)

Hugoch committed 1 year ago

Verified 73b7cf83

Fixing the oom maybe with 2.5.1 change. (#2958)

Narsil committed 1 year ago

Verified eb3df0f4

fix: Telemetry (#2957)

Hugoch committed 1 year ago

Verified c690da59

Update to attention-kernels 0.2.0 (#2950)

danieldk committed 1 year ago

Verified db922eb7

Attempt to remove AWS S3 flaky cache for sccache (#2953)

mfuntowicz committed 1 year ago

Verified 40b00275

Older