huggingface/text-generation-inference

Pull Requests Commits

Updated flake lock

Narsil committed 1 year ago

Verified 2652e209

Apply suggestions from code review

Narsil committed 1 year ago

Verified 3ece7639

Forgot last default place.

Narsil committed 1 year ago

Verified cdbf73ee

Everywhere 1.80

Narsil committed 1 year ago

Verified 3d46783f

Upgrade to 1.80 because of bitstream...

Narsil committed 1 year ago

Verified e2319fa8

Update cargo lock ?

Narsil committed 1 year ago

Verified f628886c

Updating integration tests with new values with FI/FD.

Narsil committed 1 year ago

Verified 2fe58798

Narsil committed 1 year ago

Verified e48e07c0

More specific codes.

Narsil committed 1 year ago

Verified bd0ced35

Disable prefix caching for lora.

Narsil committed 1 year ago

Verified f5ee062c

Disabling flashinfer/prefix caching on odd head_dim

Narsil committed 1 year ago

Verified 719d7b4d

Allowing window_left_size (dummy version).

Narsil committed 1 year ago

Verified 78579104

Using prebuilt.

Narsil committed 1 year ago

Verified 73fd04d6

Include flashinfer in the docker.

Narsil committed 1 year ago

Verified 53367553

Making prefix/flashinfer the default and testing the full release tests.

Narsil committed 1 year ago

Verified 52c81352

Adding eetq to flake. (#2438)

Narsil committed 1 year ago

Verified 310778e0

nix: add `text-generation-benchmark` to pure devshell (#2431)

danieldk committed 1 year ago

Verified 94744150

nix: add pure server to flake, add both pure and impure devshells (#2430)

danieldk committed 1 year ago

Verified f5f11b79

Prefix caching (#2402)

Narsil committed 1 year ago

Verified b70ae096

nix: update to CUDA 12.4 (#2429)

danieldk committed 1 year ago

Verified 38773453

All integration tests back everywhere (too many failed CI). (#2428)

Narsil committed 1 year ago

Verified e4201f44

doc: Add metrics documentation and add a 'Reference' section (#2230)

Hugoch committed 1 year ago

Verified 53729b74

Narsil committed 1 year ago

Verified cb0a2948

Further fixes. (#2426)

Narsil committed 1 year ago

Verified c7ab1810

Improve the Consuming TGI + Streaming docs. (#2412)

Vaibhavs10 committed 1 year ago

Verified 99b662f8

nix: try to reduce the number of Rust rebuilds (#2424)

danieldk committed 1 year ago

Verified 1411bfb9

Upgrading the tests to match the current workings. (#2423)

Narsil committed 1 year ago

Verified 1b0aa062

Fixing exl2 and other quanize tests again. (#2419)

Narsil committed 1 year ago

Verified 57b34958

nix: build router incrementally (#2422)

danieldk committed 1 year ago

Verified 9aaa12e7

More fixes trtllm (#2342)

mfuntowicz committed 1 year ago

Verified 3f385991

Older