Commits vllm-project/vllm

[Feature] default --extra-body param to disable thinking in vllm bench serve (#26784)

lengrongfu committed 186 days ago

Verified a27b288e

[CI/Build][Bugfix] fix qutlass cmake error when set QUTLASS_SRC_DIR (#26773)

izhuhaoran committed 186 days ago

Verified e471d7ca

[Docs] Move build.inc into arm.inc (#26862)

windsonsea committed 186 days ago

Verified c43ca825

[Model] Add DeepSeek-V3.1 reasoning parser (split from PR #24972) (#25589)

taohui committed 186 days ago

Verified 85a65e7f

[Bugfix] Fixes prefix-repetition benchmark script (#26828)

kouroshHakha committed 186 days ago

Verified a2986b3e

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

morrison-turnansky committed 186 days ago

Verified 96b9aa5a

Disable FlashInfer sampler by default (#26859)

mgoin committed 186 days ago

Verified e66d787b

[BUGFIX][NIXL] quick fix for 'assert self.connector_worker is not None' in get_kv_connector_stats (#26851)

xuechendi committed 186 days ago

Verified bfad142e

[Bugfix]fix Qwen3 xml tool parser (#26345)

Zhikaiiii committed 186 days ago

Verified 93546600

[Core][Easy] Use envs.__getattr__ for all Unify to environment variable access (#26810)

Jialin committed 186 days ago

Verified 07ca70af

[torch.compile] Fix tests for torch==2.9 inductor partition (#26116)

ProExpertProg committed 186 days ago

Verified 2dcd12d3

[WideEP][P/D] Add usage stats for DP+EP and KV Connector (#26836)

tlrmchlsmth committed 186 days ago

Verified 579d2e54

[frontend][gptoss] Add per turn stats into Harmony Context (#25061)

lacora committed 186 days ago

Verified 0512c04a

[CI Failure] Fix torchao dep failure for Quantization Test (#26824)

mgoin committed 186 days ago

Verified 7e0ef408

[Core] Streamline some structured output related code (#26737)

njhill committed 186 days ago

Verified 4aed506b

remove attn output view kernel (#26680)

BoyuanFeng committed 186 days ago

Verified a86b4c58

[Minor] Group async_scheduling related fields in model runner init (#26736)

njhill committed 186 days ago

Verified ff4810ba

fix: response_format for completion (#23212)

Nan2018 committed 186 days ago

Verified 9d696492

Added MoE configs for llama 4, H200 device with tp=4/8 tuning (#26837)

Dhruvilbhatt committed 186 days ago

Verified 0e658189

[Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146)

Jialin committed 186 days ago

Verified 380f1752

Notice for deprecation of AutoAWQ (#26820)

HDCharles committed 187 days ago

Verified b92ab3de

[Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964)

Jialin committed 187 days ago

Verified acaa2c0a

[Attention][Spec Decode] FlashMLA spec decode support (#26541)

MatthewBonanni committed 187 days ago

Verified 82af928c

llama4_vision_rope: add HIP override to accept (q, k) and avoid (positions, q, k) mismatch (#26790)

hl475 committed 187 days ago

Verified 87efc681

[CI Failure] Fix tests with missing TinyLlama-1.1B-Chat-v1.0-FP8-e2e (#26816)

mgoin committed 187 days ago

Verified c3a722fc

[Kernel][MoE] Add MoE tunings for GLM 4.6-FP8 and GLM 4.5 Air on NVidia B200 (#26818)

zklapow committed 187 days ago

Verified aba48f7d

[CI] Raise VLLM_MAX_SIZE_MB to 500 due to failing Build wheel - CUDA 12.9 (#26722)

mgoin committed 187 days ago

Verified 04b5f980

Update coveragerc and add codecov.yml for path fixes (#26435)

rzabarazesh committed 187 days ago

Verified efc8f7d8

[Config] Remove Unused Environment Variable `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` (#26743)

yewentao256 committed 187 days ago

Verified 6d87a283

Revert "[issues template] Encourage the author implement their own ideas" (#26814)

noooop committed 187 days ago

Verified e6cdbd67