vllm-project/vllm

Pull Requests Commits

ShriKode committed 1 year ago

b801bf30

ShriKode committed 1 year ago

bfd63b1b

[CI/Build] Allow hermetic builds (#18064)

fabiendupont committed 1 year ago

Verified 3c545c0c

[Bugfix] Fix some narrowing conversion warnings (#20141)

tlrmchlsmth committed 1 year ago

Verified e8c3bd2c

[Bugfix] Mark 'hidden_states' as mutable in moe_forward registration. (#20152)

bnellnm committed 1 year ago

Verified c6c98305

[Fix][torch.compile] Enable custom ops by default when Inductor off (#20102)

ProExpertProg committed 1 year ago

Verified aafabaa0

[Fix][ROCm] Remove unused variables to fix build error on GFX11/12 (#19891)

hyoon1 committed 1 year ago

Verified 94a55c76

[Perf] Improved perf for resolve_chat_template_content_format (#20065)

ilyal-cerebras committed 1 year ago

Verified aa0dc77e

[Bugfix] Fix flaky failure when getting DP ports (#20151)

mgoin committed 1 year ago

Verified 4ab3ac28

Gemma3n (Text-only) (#20134)

robertgshaw2-redhat committed 1 year ago

Verified d1c956dc

Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143)

xuechendi committed 1 year ago

Verified dec197e3

[Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946)

Yazan-Sharaya committed 1 year ago

Verified 6e244ae0

[Model][1/N] Automatic conversion of CrossEncoding model (#20012)

noooop committed 1 year ago

Verified cd4cfee6

[Fix] Fix gemma CI test failing on main (#20124)

tdoublep committed 1 year ago

Verified e1109306

[CI] Sync test dependency with test.in for torch nightly (#19632)

yangw-dev committed 1 year ago

Verified 8b64c895

[Feature] add quick all reduce (#19744)

lihaoyang-amd committed 1 year ago

Verified 0740e29b

[Bugfix] Build moe_data for both sm100 and sm90 (#20086)

mgoin committed 1 year ago

Verified 44d2e6af

[Perf] SM100 FP8 GEMM Optimizations after cutlass_profiler (#20071)

ilmarkov committed 1 year ago

Verified 2d7779f8

[Quantization] Bump to use latest `compressed-tensors` (#20033)

dsikka committed 1 year ago

Verified a57d57fa

[CI Failure] Fix OOM with test_oot_registration_embedding (#20144)

mgoin committed 1 year ago

Verified 71799fd0

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

abmfy committed 1 year ago

Verified e9fd658a

[Doc] correct LoRA capitalization (#20135)

kyolebu committed 1 year ago

Verified 07b8fae2

[Refactor] Rename commnication utils (#20091)

yewentao256 committed 1 year ago

Verified 56230881

[TPU] add kv cache update kernel (#19928)

yaochengji committed 1 year ago

Verified 04e1642e

[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)

jikunshang committed 1 year ago

Verified b69781f1

Spam folks if config.py changes (#20131)

tlrmchlsmth committed 1 year ago

Verified 0bceac98

[Doc] Rename page titles (#20130)

DarkLight1337 committed 1 year ago

Verified 34878a0b

[Doc] Auto sign-off for VSCode (#20132)

DarkLight1337 committed 1 year ago

Verified 6393b039

[Doc] Automatically signed-off by PyCharm (#20120)

noooop committed 1 year ago

Verified 0907d507

[Bug Fix] Fix address/port already in use error for deep_ep test (#20094)

yewentao256 committed 1 year ago

Verified c894c5dc

Older