huggingface/text-generation-inference

Pull Requests Commits

More tensor cores. (#2558)

Narsil committed 1 year ago

Verified dd8691b7

Cleanup Vertex + Chat (#2553)

Narsil committed 1 year ago

Verified c032280b

Hotfixing main. (#2562)

Narsil committed 1 year ago

Verified 75c8c54a

Adding note for private models in quick-tour document (#2548)

ariG23498 committed 1 year ago

Verified e6d29656

Simplify crossterm imports (#2545)

orhun committed 1 year ago

Verified 8024ded5

Update the link to the Ratatui organization (#2546)

orhun committed 1 year ago

Verified 03263f5e

Add `DenseMoELayer` and wire it up in Mixtral/Deepseek V2 (#2537)

danieldk committed 1 year ago

Verified 3f14cd14

Add support for scalar FP8 weight scales (#2550)

danieldk committed 1 year ago

Verified c29dc89c

Hotfixing main (#2556)

Narsil committed 1 year ago

Verified 0ff6ff60

Micro cleanup. (#2555)

Narsil committed 1 year ago

Verified 74d3ce10

Remove duplicated `RUN` in `Dockerfile` (#2547)

alvarobartt committed 1 year ago

Verified d31a6f75

chore: Add old V2 backend (#2551)

OlivierDehaene committed 1 year ago

Verified 10e6f292

nix: remove unused `_server.nix` file (#2538)

danieldk committed 1 year ago

Verified 9263817c

Preparing for release. (#2540)

Narsil committed 1 year ago

Verified 169178b9

fix: wrap python basic logs in debug assertion in launcher (#2539)

OlivierDehaene committed 1 year ago

Verified 7e2d1887

hotfix: ipex fails since cuda moe kernel is not supported (#2532)

sywangyi committed 1 year ago

Verified f478aa77

doc: clarify that `--quantize` is not needed for pre-quantized models (#2536)

danieldk committed 1 year ago

Verified abd24dd3

Update to moe-kenels 0.3.1 (#2535)

danieldk committed 1 year ago

Verified c1037601

Stream options. (#2533)

Narsil committed 1 year ago

Verified f512021e

Move to moe-kernels package and switch to common MoE layer (#2511)

danieldk committed 1 year ago

Verified ce85efa9

fix: metrics unbounded memory (#2528)

OlivierDehaene committed 1 year ago

Verified 86984e32

nix: pure Rust check/fmt/clippy/test (#2525)

danieldk committed 1 year ago

Verified 71e42686

Adding a test for FD. (#2516)

Narsil committed 1 year ago

Verified 38fcafcf

Add tests for Mixtral (#2520)

danieldk committed 1 year ago

Verified 77746552

Use `ratatui` not (deprecated) `tui` (#2521)

strickvl committed 1 year ago

Verified 9cca3e0b

hotfix : enable intel ipex cpu and xpu in python3.11 (#2517)

sywangyi committed 1 year ago

Verified 3ac7df2b

fix: pass missing revision arg for lora adapter when loading multiple… (#2510)

drbh committed 1 year ago

Verified 628334d3

Add nix test. (#2513)

Narsil committed 1 year ago

Verified d95c670a

nix: support Python tokenizer conversion in the router (#2515)

danieldk committed 1 year ago

Verified 94304649

Fix truffle (#2514)

Narsil committed 1 year ago

Verified 69e3be20

Newer Older