huggingface/text-generation-inference

Pull Requests Commits

mht-sharma committed 1 year ago

0a5b19a3

mht-sharma committed 1 year ago

6d6b0bdc

mht-sharma committed 1 year ago

f34560f7

mht-sharma committed 1 year ago

bf4db771

update launcher

mht-sharma committed 1 year ago

5e38d353

mht-sharma committed 1 year ago

15b351b4

add AMMO example

mht-sharma committed 1 year ago

1e6e7db0

add torch dtype

mht-sharma committed 1 year ago

a7909e6f

mht-sharma committed 1 year ago

f4714a8f

revert makefile

mht-sharma committed 1 year ago

3ae62304

mht-sharma committed 1 year ago

034686b1

update launcher

mht-sharma committed 1 year ago

e81c4cf8

mht-sharma committed 1 year ago

3cc2f4e9

mht-sharma committed 1 year ago

001ec09d

mht-sharma committed 1 year ago

50806ffe

mht-sharma committed 1 year ago

557e18e0

mht-sharma committed 1 year ago

8a0bb53e

mht-sharma committed 1 year ago

f0d95b0f

mht-sharma committed 1 year ago

fb83e341

rebase and update

mht-sharma committed 1 year ago

81fd601c

Merge branch 'main' into fp8_kvcache

mht-sharma committed 1 year ago

084de990

Factor out sharding of packed tensors (#2059)

danieldk committed 1 year ago

Verified bcb3faa1

Support exl2-quantized Qwen2 models (#2085)

danieldk committed 1 year ago

Verified f5a98375

feat: rotate tests ci token (#2091)

drbh committed 1 year ago

Verified cdbf8028

CI: pass pre-commit hooks again (#2084)

danieldk committed 1 year ago

Verified 11ea9ce0

CI: Tailscale improvements (#2079)

glegendre01 committed 1 year ago

Verified 4f25c67d

Set maximum grpc message receive size to 2GiB (#2075)

danieldk committed 1 year ago

Verified c8c7ccd3

fix build.rs watch files (#2072)

zirconium-n committed 1 year ago

Verified 0f7d38e7

Contributing guide & Code of Conduct (#2074)

LysandreJik committed 1 year ago

Verified 13183891

Support different image sizes in prefill in VLMs (#2065)

danieldk committed 1 year ago

Verified e9037708

Older