huggingface/text-generation-inference

Pull Requests Commits

Merge branch 'fix_rocm_fa' into rocm_6.2_fixes

mht-sharma committed 1 year ago

afe3fed1

fix issue for sliding window models

mht-sharma committed 1 year ago

64e981fd

mht-sharma committed 1 year ago

21d1b0cd

hotfix: ipex fails since cuda moe kernel is not supported (#2532)

sywangyi committed 1 year ago

Verified f478aa77

doc: clarify that `--quantize` is not needed for pre-quantized models (#2536)

danieldk committed 1 year ago

Verified abd24dd3

Update to moe-kenels 0.3.1 (#2535)

danieldk committed 1 year ago

Verified c1037601

Stream options. (#2533)

Narsil committed 1 year ago

Verified f512021e

Merge branch 'fix_rocm_fa' into rocm_6.2_fixes

mht-sharma committed 1 year ago

b6794da3

mht-sharma committed 1 year ago

4fb947d2

Merge branch 'fix_rocm_fa' into rocm_6.2_fixes

mht-sharma committed 1 year ago

41b297a2

mht-sharma committed 1 year ago

e6d07a6d

Move to moe-kernels package and switch to common MoE layer (#2511)

danieldk committed 1 year ago

Verified ce85efa9

fix: metrics unbounded memory (#2528)

OlivierDehaene committed 1 year ago

Verified 86984e32

nix: pure Rust check/fmt/clippy/test (#2525)

danieldk committed 1 year ago

Verified 71e42686

Adding a test for FD. (#2516)

Narsil committed 1 year ago

Verified 38fcafcf

Add tests for Mixtral (#2520)

danieldk committed 1 year ago

Verified 77746552

Use `ratatui` not (deprecated) `tui` (#2521)

strickvl committed 1 year ago

Verified 9cca3e0b

mht-sharma committed 1 year ago

4ba9210f

hotfix : enable intel ipex cpu and xpu in python3.11 (#2517)

sywangyi committed 1 year ago

Verified 3ac7df2b

fix: pass missing revision arg for lora adapter when loading multiple… (#2510)

drbh committed 1 year ago

Verified 628334d3

add skinny kernel and merge fixes

mht-sharma committed 1 year ago

59fd0cbd

Add nix test. (#2513)

Narsil committed 1 year ago

Verified d95c670a

nix: support Python tokenizer conversion in the router (#2515)

danieldk committed 1 year ago

Verified 94304649

Fix truffle (#2514)

Narsil committed 1 year ago

Verified 69e3be20

Fix tokenization yi (#2507)

Narsil committed 1 year ago

Verified dae3bf1d

Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)

Narsil committed 1 year ago

Verified a4e3e8c6

fixed merge conflicts

mht-sharma committed 1 year ago

05816268

fix mixtral model

mht-sharma committed 1 year ago

03458164

mht-sharma committed 1 year ago

e2f48fae

mht-sharma committed 1 year ago

f3bc0384

Older