vllm-project/vllm

Pull Requests Commits

minimize metrics tracker changes

BugenZhao committed 24 days ago

Verified 36c723e8

task validation & resolve default value on engine side

BugenZhao committed 24 days ago

Verified 4a8f840e

add `get_supported_tasks` interfaces

BugenZhao committed 24 days ago

Verified 0ad8e895

add example for llm embedding

BugenZhao committed 24 days ago

Verified 39f25f45

simplify metrics impl & tensor conversion

BugenZhao committed 24 days ago

Verified 15108cd6

add `encode` to LLM & engine core client layer

BugenZhao committed 24 days ago

Verified d4712ba0

[Docs][EC Connector] CPU EC Connector usage Docs (#54522)

omerpaz95 committed 24 days ago

Verified a97dacb7

[ROCm][Perf][Bugfix] Multi-stream perf improvements; rocprofiler fixes (#55099)

mawong-amd committed 24 days ago

Verified bc8587f8

[Bugfix] Parse DSML tool calls when the model omits the tool_calls wrapper (#55954)

sfeng33 committed 24 days ago

Verified d98c8c03

[Kernel] Add NVFP4 support to the torch linear backend (#53319)

mlazos committed 24 days ago

Verified 28a73ccf

[Core] Enhance cpu<->gpu sync checking to include paged async copies (#53491)

njhill committed 24 days ago

Verified 4aadb0f1

[Kernel] Enable optimized FlashInfer add-RMSNorm NVFP4 fusion (#51925)

soodoshll committed 24 days ago

Verified 9e137d8d

[Bugfix][Spec Decode] Preserve target parallel config (DCP) for DSpark (#55472)

starkwj committed 24 days ago

Verified c2681987

[Bugfix] Fix OpenPangu multimodal embedding merge (#55941)

taneem-ibrahim committed 24 days ago

Verified 5af4cc33

[Bugfix][Spec Decode] Honour the draft's moe_backend on Model Runner V2 (#54788)

stecasta committed 24 days ago

Verified 9c2d2104

[Transformers] Generalize merged-column linear fusion (#55301)

BANANASJIM committed 24 days ago

Verified c0d8d541

Fix block FP8 MTP in ModelOpt mixed checkpoints (#55513)

sychen52 committed 24 days ago

Verified 60ad959b

[ROCm][DI][CI] Enable WideEP Intranode tests (#53195)

lcskrishna committed 24 days ago

Verified 28a2ccee

[CI] Fix ARM64 test dependency builds with GCC 15 (#55877)

khluu committed 24 days ago

Verified 05e52f63

[Misc] Bump `openai` to `>=2.25.0` to support namespace tools types (#49104)

cjackal committed 24 days ago

Verified bf339618

[Kimi Bug] Fix kda ima `Triton Error [CUDA]: an illegal memory access was encountered` (#55924)

yewentao256 committed 24 days ago

Verified bfb443a6

[Perf] Eliminate full-history reasoning scans for structured outputs (#55223)

sfeng33 committed 24 days ago

Verified 0a742da2

[Perf] Eliminate full-history reasoning scans for structured outputs (#55223)

sfeng33 committed 24 days ago

Verified 29f46ac4

[CI][ROCm] Increase timeouts for AMD MI300 jobs (#55919)

djramic committed 24 days ago

Verified 73f61d12

[Attention] Require explicit DCP support from attention implementations (#55780)

AndreasKaratzas committed 24 days ago

Verified db3814a4

[CI] Reuse ColQwen3 models across pooling tests (#55889)

AndreasKaratzas committed 24 days ago

Verified cb222346

[Core] Let SWA layers take the primary block size to avoid inflating the KV block LCM (#53007)

bnellnm committed 24 days ago

Verified d29c88f1

[CI] Split long misc test groups by command (#52346)

khluu committed 24 days ago

Verified 808353f4

[Bugfix] Handle null RoPE parameters for NoPE layers (#55949)

AndreasKaratzas committed 24 days ago

Verified 18615ad1

[2/N][KV Connector][NIXL] Support per-region transfer geometry (#53780)

MatthewBonanni committed 24 days ago

Verified e0aaef85

Older