vllm-project/vllm

Pull Requests Commits

revert skip-merge-desc

Robert Shaw committed 158 days ago

7d092fc3

Robert Shaw committed 158 days ago

1a6c27f2

Robert Shaw committed 158 days ago

3c6fd286

[CI] Trimming some failing test groups from AMDPRODUCTION. (#20390)

Alexei-V-Ivanov-AMD committed 158 days ago

Verified 536fd330

[Frontend] fix duplicate output for bench subcmd (#20446)

reidliu41 committed 158 days ago

Verified 619b9f5c

[Bugfix] Fix flaky `test_streaming_response` test (#20363)

NickLucche committed 158 days ago

Verified d1b689c4

[Frontend] improve vllm bench <bench_type> --help display (#20430)

reidliu41 committed 158 days ago

Verified 9854dc90

[Misc] Automatically tag PRs to add new models (#20222)

Isotr0py committed 158 days ago

Verified ff5c60fa

[Model][2/N] Automatic conversion of CrossEncoding model (#19978)

noooop committed 158 days ago

Verified 6f1229f9

[Quantization] Bump to use latest bitsandbytes (#20424)

jeejeelee committed 158 days ago

Verified 1819fbda

[CI/Build][CPU] Enable cross compilation in CPU release pipeline (#20423)

bigPYJ1151 committed 158 days ago

Verified 7f036710

[Kernel] refactor cpu worker v0 cache dtype (#20080)

andyxning committed 158 days ago

Verified fb14d53c

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

DarkLight1337 committed 158 days ago

Verified b024a42e

[Docs] Replace two list with tables in intel_gaudi.md (#20414)

windsonsea committed 158 days ago

Verified cb97f2bf

[doc] fix link (#20417)

reidliu41 committed 158 days ago

Verified 359200f6

[Misc] Add rules to label Speculative Decoding Related PRs (#20406)

draftbk committed 158 days ago

Verified 220aee90

[Tests] Update online DP tests to verify that requests are balanced (#20157)

njhill committed 158 days ago

Verified 67d25eca

[Feature] Support MiniMax-M1 function calls features (#20297)

qscqesze committed 158 days ago

Verified 363528de

[TPU] Add a case to cover RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 (#20385)

QiliangCui committed 158 days ago

Verified 4ff61aba

[Bugfix][CI/CD][CPU] Fix CPU CI tests (#20383)

bigPYJ1151 committed 158 days ago

Verified 0ec3779d

[Misc] Small: Fix video loader return type annotations. (#20389)

huachenheli committed 158 days ago

Verified b616f6a5

[Bugfix] Fix import of CutlassExpertsFp8 in compressed_tensors_moe.py (#20381)

bnellnm committed 158 days ago

Verified 2e25bb12

Enable CPU nightly performance benchmark and its Markdown report (#18444)

louie-tsai committed 159 days ago

Verified 9965c47d

[BugFix] Fix DP headless mode arg validation (#20398)

njhill committed 159 days ago

Verified 059d4cdb

[Bugfix] Fixes for FlashInfer's TORCH_CUDA_ARCH_LIST (#20136)

tlrmchlsmth committed 159 days ago

Verified bdb84e26

[Docs] Update EAGLE example (#20375)

NickLucche committed 159 days ago

Verified 3dd35914

[DP] Support external DP Load Balancer mode (#19790)

njhill committed 159 days ago

Verified 657f2f30

[ROCm][FEAT] Enable Full Graph Mode in AITER MLA V1 Attn Backend (Decode Phase only) (#20254)

vllmellm committed 159 days ago

Verified a1aafc82

[Misc] add handler HF_TOKEN is emptry string (#20369)

lengrongfu committed 159 days ago

Verified 139508a4

[Minor] Clean up incorrect comment in test (#20382)

njhill committed 159 days ago

Verified d265414d

Older