huggingface/text-generation-inference

Pull Requests Commits

enable intel ipex cpu and xpu in python3.11

sywangyi committed 1 year ago

6b995cca

Fix truffle (#2514)

Narsil committed 1 year ago

Verified 69e3be20

Fix tokenization yi (#2507)

Narsil committed 1 year ago

Verified dae3bf1d

Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)

Narsil committed 1 year ago

Verified a4e3e8c6

Add Directory Check to Prevent Redundant Cloning in Build Process (#2486)

vamsivallepu committed 1 year ago

Verified eabbbbda

Fixing more correctly the invalid drop of the batch. (#2498)

Narsil committed 1 year ago

Verified c1fe28d6

Add links to Adyen blogpost (#2500)

martinigoyanes committed 1 year ago

Verified aaea212d

hotfix: add syrupy to the right subproject (#2499)

danieldk committed 1 year ago

Verified a3c9c62d

radix trie: add assertions (#2491)

danieldk committed 1 year ago

Verified 379472c4

Fix incompatibility with latest `syrupy` and update in Poetry (#2497)

danieldk committed 1 year ago

Verified 2eb57a15

nix: add pyright/ruff for proper LSP in the impure devshell (#2496)

danieldk committed 1 year ago

Verified 0424e27f

hotfix: fix regression of attention api change in intel platform (#2439)

sywangyi committed 1 year ago

Verified 5cd8025f

Add two handy gitignores for Nix environments (#2484)

danieldk committed 1 year ago

Verified e279b38a

Adding links to Adyen blogpost. (#2492)

Narsil committed 1 year ago

Verified 8b96a182

hotfix: avoid non-prefilled block use when using prefix caching (#2489)

danieldk committed 1 year ago

Verified deec30f8

feat: support lora revisions and qkv_proj weights (#2482)

drbh committed 1 year ago

Verified 6cb42f49

fix: enable chat requests in vertex endpoint (#2481)

drbh committed 1 year ago

Verified 47d7e344

nix: add punica-kernels (#2477)

danieldk committed 1 year ago

Verified de2cdeca

nix: improve impure devshell (#2478)

danieldk committed 1 year ago

Verified e4ab8554

Tied embeddings in MLP speculator. (#2473)

Narsil committed 1 year ago

Verified d9fbbaaf

update doc with intel cpu part (#2420)

sywangyi committed 1 year ago

Verified 9883f3b4

feat: add /v1/models endpoint (#2433)

drbh committed 1 year ago

Verified d5202c46

Lots of improvements (Still 2 allocators) (#2449)

Narsil committed 1 year ago

Verified e415b690

nix: build Torch against MKL and various other improvements (#2469)

danieldk committed 1 year ago

Verified 4e821c00

fix: improve regex expression (#2468)

drbh committed 1 year ago

Verified 8f99f165

fix: bump minijinja version and add test for llama 3.1 tools (#2463)

drbh committed 1 year ago

Verified 21187c27

Fixing CI. (#2462)

Narsil committed 1 year ago

Verified 2788d41a

Pr 2451 ci branch (#2454)

drbh committed 1 year ago

Verified cfa73b5c

Fix: don't apply post layernorm in SiglipVisionTransformer (#2459)

drbh committed 1 year ago

Verified 30be1884

nix: add default package (#2453)

danieldk committed 1 year ago

Verified f3c5d7d9

Older