vllm-project/vllm

Pull Requests Commits

Update docs/serving/parallelism_scaling.md

yewentao256 committed 12 hours ago

Verified c330d607

remove default ray dependency

yewentao256 committed 12 hours ago

16781aea

[CI] Add explicit permissions to macOS smoke test workflow (#35775)

russellb committed 12 hours ago

Verified 5395471d

[BugFix] Fallback from FA4->FA2 for Batch Invariance (#36059)

frankwang28 committed 12 hours ago

Verified a57c877f

[Perf] Optimize FusedMoEModularKernel output tensor using torch.empty (#35794)

xyang16 committed 12 hours ago

Verified f9170209

[Bugfix] Disable FlashInfer TRTLLM BF16 path for non-gated MoE (#36146)

tomeras91 committed 13 hours ago

Verified 86483ca7

ParakeetProjection.norm = RMSNorm instead of nn.LayerNorm (#36133)

netanel-haber committed 14 hours ago

Verified b93a9e6f

[XPU] Enable ModelRunnerV2 on XPU (#36078)

xinyu-intel committed 14 hours ago

Verified d8839ef7

[BUGFIX]Fix Qwen-Omni models audio max_token_per_item estimation error leading to encoder_cache_size is 0 (#35994)

jjmiao1 committed 14 hours ago

Verified e998fa76

[Bugfix][CI] fix typos (#34934)

1195343015 committed 14 hours ago

Verified 6a895197

[ROCm] Refactor ROCm attention backend selection logic (#35246)

SageMoore committed 14 hours ago

Verified 8c760b6a

refactor funasr model. (#36108)

AllenDou committed 15 hours ago

Verified 3ee68590

[Bugfix] Fix Qwen-VL tokenizer implementation (#36140)

DarkLight1337 committed 15 hours ago

Verified 71963481

[openai api] log exception in exception handler (1/N) (#31164)

andyxning committed 15 hours ago

Verified 176c799f

[KVConnector] Scheduler: Fix num_computed_tokens after async KV load (#34616)

orozery committed 17 hours ago

Verified 612e7729

Fix import that was moved in Transformers 5.2.0 (#36120)

hmellor committed 17 hours ago

Verified ecde7af9

[Docs] Only build docs if `documentation` or `ready` labels are present (#36135)

hmellor committed 17 hours ago

Verified 8df52335

[CI] Stabilize test_no_args_tool_call and add ROCm-specific server args (#36107)

AndreasKaratzas committed 17 hours ago

Verified b03ff6a9

[Bugfix] Fix RunAI streamer crash with S3-hosted model paths (#35976)

AjAnubolu committed 19 hours ago

Verified ed81d5ed

[Bugfix] Fix mypy errors in hermes_tool_parser.py (#36114)

842974287 committed 19 hours ago

Verified 3c23ac84

[Misc] Fix SyntaxWarning - invalid escape sequence '\e' (#36020)

cjackal committed 20 hours ago

Verified a708ef59

[Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085)

jikunshang committed 21 hours ago

Verified 66a22096

[Release] Include source distribution (sdist) in PyPI uploads (#35136)

dougbtv committed 21 hours ago

Verified 0bfa229b

[Docs] add Dynamo/aibrix integration and kubeai/aks link (#32767)

pacoxu committed 21 hours ago

Verified 7493c51c

[Docs] Update docs to include mm processor + encoder benchmarks (#34083)

reaganjlee committed 21 hours ago

Verified ac773bbe

qwen3coder tool parser fix anyOf double encoded parameters (#36032)

cmunley1 committed 22 hours ago

Verified 48e376a0

[Chore] Correct MTP models test registry ordering (#36115)

Isotr0py committed 22 hours ago

Verified 21eb2c33

[Docs] Update `CacheConfig` block_size docstring to remove inaccurate limit when using CUDA (#35632)

eicherseiji committed 1 day ago

Verified e2b31243

[Misc] Remove deprecated items that are due for removal (#36006)

hickeyma committed 1 day ago

Verified c3598d02

[Bugfix] Fix block_size for hybrid model MTP (#36036)

benchislett committed 1 day ago

Verified 57c629e9

Older