huggingface/text-generation-inference

Pull Requests Commits

(fix) quantize=fp8

mht-sharma committed 1 year ago

8cc2febd

(feat) fp8 fnuz support for rocm

mht-sharma committed 1 year ago

8ee9823d

cleaned dockerfile

mht-sharma committed 1 year ago

2401fdc8

improve dockerfile

mht-sharma committed 1 year ago

3b28cf90

mht-sharma committed 1 year ago

7cb49f6f

fix imports after rebase

mht-sharma committed 1 year ago

b2cd1b66

Merge remote-tracking branch 'upstream/main' into rocm_6.2_updates

mht-sharma committed 1 year ago

473d9a89

Improve support for GPUs with capability < 8 (#2575)

danieldk committed 1 year ago

Verified 5b6b74e2

mht-sharma committed 1 year ago

346dfe39

updated default value

mht-sharma committed 1 year ago

a24c2cc5

improved error messag

mht-sharma committed 1 year ago

ac2dccd1

mht-sharma committed 1 year ago

816d4b67

Merge remote-tracking branch 'upstream/main' into fix_rocm_fa

mht-sharma committed 1 year ago

47c81d29

addressed review comments

mht-sharma committed 1 year ago

829144d1

Fix build with `--features google` (#2566)

alvarobartt committed 1 year ago

Verified 0aa66d69

Add LoRA adapters support for Gemma2 (#2567)

alvarobartt committed 1 year ago

Verified 0b7df771

remove LORA_ADAPTERS_PATH (#2563)

nbroad1881 committed 1 year ago

Verified 7efcb5e0

More tensor cores. (#2558)

Narsil committed 1 year ago

Verified dd8691b7

Cleanup Vertex + Chat (#2553)

Narsil committed 1 year ago

Verified c032280b

Hotfixing main. (#2562)

Narsil committed 1 year ago

Verified 75c8c54a

Adding note for private models in quick-tour document (#2548)

ariG23498 committed 1 year ago

Verified e6d29656

Simplify crossterm imports (#2545)

orhun committed 1 year ago

Verified 8024ded5

Update the link to the Ratatui organization (#2546)

orhun committed 1 year ago

Verified 03263f5e

Add `DenseMoELayer` and wire it up in Mixtral/Deepseek V2 (#2537)

danieldk committed 1 year ago

Verified 3f14cd14

Add support for scalar FP8 weight scales (#2550)

danieldk committed 1 year ago

Verified c29dc89c

fix issue for sliding window models

mht-sharma committed 1 year ago

64e981fd

Hotfixing main (#2556)

Narsil committed 1 year ago

Verified 0ff6ff60

Micro cleanup. (#2555)

Narsil committed 1 year ago

Verified 74d3ce10

Remove duplicated `RUN` in `Dockerfile` (#2547)

alvarobartt committed 1 year ago

Verified d31a6f75

chore: Add old V2 backend (#2551)

OlivierDehaene committed 1 year ago

Verified 10e6f292

Older