vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into remove-bitblas

robertgshaw2-redhat committed 1 day ago

Verified 8352224b

[Quantization][Deprecation] Deprecate HQQ (#32681)

robertgshaw2-redhat committed 1 day ago

Verified 85f55c94

[Quantization][Deprecation] Remove `DeepSpeedFp8` (#32679)

robertgshaw2-redhat committed 1 day ago

Verified cea3c754

[MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414)

robertgshaw2-redhat committed 1 day ago

Verified 42135d68

[bugfix] Aria model (#32727)

divakar-amd committed 2 days ago

Verified e14467be

[Model] Add Eagle2.5-8B Vision-Language Model support (#32456)

George-Polya committed 2 days ago

Verified 7727ce35

[Bugfix] Force using spawn multiprocess method when it's the WSL platform (#32749)

jasonyanwenl committed 2 days ago

Verified 6bb2bc71

[Documentation] Fix typo in `docs/design/torch_compile_multimodal.md` (#32741)

Lucaskabela committed 2 days ago

Verified c80f92c1

[Bugfix] Support HF sharded weights for Mistral3/Pixtral models (#32673)

ricky-chaoju committed 2 days ago

Verified f23fb5a7

[Docs] Fix GitHub handle in governance process (#32582)

pacoxu committed 2 days ago

Verified 360aa93f

[Bugfix] Fix Nemotron-Nano-v2-vlm static resolution (#32682)

netanel-haber committed 2 days ago

Verified 27ca95b3

Update FlashMLA (#32491)

LucasWilkinson committed 2 days ago

Verified b4f64e5b

Added qwen3 vision language moe support for speculative decoding (#32048)

shanjiaz committed 2 days ago

Verified 7ab80a8e

Enable Eagle3 speculative decoding for Pixtral (LlavaForConditionalGeneration) (#32542)

gopalsarda committed 2 days ago

Verified 0900cedb

[Cleanup] Remove unused `KVConnectorModelRunnerMixin` methods (#32077)

njhill committed 2 days ago

Verified 6f067b1f

[Bugfix] Fix Granite Vision / Don't use Siglip Pooling Head Nested Models by Default (#32299)

alex-jw-brooks committed 2 days ago

Verified 27b81e01

OffloadingConnector: Prevent redundant loads (#29087)

orozery committed 2 days ago

Verified 7013e9ac

Revert "[PluggableLayer][1/N] Define PluggableLayer" (#32725)

robertgshaw2-redhat committed 2 days ago

Verified c78ee240

fp8 online quant: split out Fp8OnlineLinearMethod (#32189)

vkuzo committed 2 days ago

Verified d2389c12

[ROCm][CI] Remove DS async eplb accuracy test from AMD CI (#32717)

micah-wil committed 2 days ago

Verified 22375f8d

[Bugfix] Suppress log on non-ROCm platform (#32703)

tjtanaa committed 2 days ago

Verified 9b67338b

[Misc] Remove pad_for_cudagraphs from config (#30143)

LucasWilkinson committed 2 days ago

Verified 22613408

[Bugfix] Fix byte fallback handling when using outlines (#31391)

Alnusjaponica committed 2 days ago

Verified 86c69dc5

[AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205)

dolpm committed 2 days ago

Verified 7c5dedc2

[5/N] Initialize MM components in context managers (Q-Z) (#32695)

DarkLight1337 committed 2 days ago

Verified 193069d1

Test: added acceptance length tests (#32030)

rahul-tuli committed 2 days ago

Verified f0feb1cf

[Doc] Update docs for MM model development with context usage (#32691)

DarkLight1337 committed 2 days ago

Verified 09194b90

[Model Runner V2] Support FLASHINFER_MLA backend (#32709)

WoosukKwon committed 2 days ago

Verified 9ab4388c

[Bugfix] fix the ima issue of qwen-vit (#32687)

JJJYmmm committed 2 days ago

Verified 04a9e064

[Doc] [ROCm] Update ROCm getting started doc (#32580)

tjtanaa committed 2 days ago

Verified c025263d

Older