vllm-project/vllm

Pull Requests Commits

Sample ENA allowance counters, socket usage, and conntrack occupancy

khluu committed 1 hour ago

1be39095

Detach baseline sampler with setsid and add foreground upload probe

khluu committed 2 hours ago

3f2022e2

Ship baseline samples as artifacts with shipping diagnostics kept

khluu committed 2 hours ago

7ce7dda1

Ship baseline samples via annotation so evidence survives log-pipe closure and agent loss

khluu committed 3 hours ago

b259a893

Extend baseline sampler with CPU utilization, cgroup accounting, and network counters

khluu committed 3 hours ago

2043b78a

Add diagnostic heartbeat sampler hook for CPU image build baseline

khluu committed 3 hours ago

bae661c3

[Rust Frontend] Replace external `protoc` with pure Rust lib `protox` (#52892)

BugenZhao committed 3 hours ago

Verified 83c5d592

[Bugfix][Spec Decode] Scope DSpark backend inheritance to DeepSeek V4 (#52809)

mgoin committed 3 hours ago

Verified 91a893de

[Bugfix] Load untied Gemma LM head weights (#53170)

khluu committed 4 hours ago

Verified d29f7f5c

[Rust Frontend] Support `--generation-config vllm` (#53044)

BugenZhao committed 4 hours ago

Verified f32b17b6

[CI][Docker] Pin remaining manylinux builder images (#53172)

khluu committed 5 hours ago

Verified 0a5a5513

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)

matthewkotila committed 6 hours ago

Verified 7cfb97e3

Fix seed loss when batch contains unseeded requests (#51866)

MKQuantum committed 6 hours ago

Verified 2f41c894

[CI][Docker] Pin manylinux2_28-builder:cuda13.0 to the release/2.13 image (#52994)

atalman committed 6 hours ago

Verified 54ba80d9

[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989)

mgoin committed 8 hours ago

Verified bfb6c134

[DSV4][Kernel] Fuse shared experts into MegaMoE (#53040)

gcanlin committed 9 hours ago

Verified 4f6885ff

[CI/Build][ROCm] Keep the CUDA-only kernel tests out of the ROCm run (#53113)

stefankoncarevic committed 10 hours ago

Verified 3b829cf1

[Bugfix] Support MistralCommonBackend tokenizers in structured output (#52720)

thanhpt1110 committed 10 hours ago

Verified d56bbf39

[Bugfix][MiniMax-M3] Keep FP8 query allocation stable across CUDA graph replay (#51203)

kyleliang-nv committed 11 hours ago

Verified 7c8b68b9

[Misc] Don't allow language-model-only used with encoder CG together (#53127)

Isotr0py committed 11 hours ago

Verified 00f7f258

upgrade tpu-inference to v0.27.0 (#53088)

meiyeh123 committed 12 hours ago

Verified ae256289

Reduce `AutoWeightsLoader` kwargs (#53106)

hmellor committed 13 hours ago

Verified 1fe3a157

Fix Transformers modelling backend `RMSNormFuser.fuse` performance (#52766)

hmellor committed 13 hours ago

Verified 2dd17225

[Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)

zupengwang committed 13 hours ago

Verified 01af92e1

[Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)

Yiqin-17 committed 14 hours ago

Verified cb09dd74

[Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204)

seonjinn committed 14 hours ago

Verified bd8865a2

[Bugfix] Skip MM processor cache inserts larger than capacity (#53016)

Prudhvivuda committed 15 hours ago

Verified de216b6e

[Docker] Update to nixl-1.3.2 (#51777)

sandeep-maddipatla committed 16 hours ago

Verified 4b7cb949

[Model] Add tower and connector LoRA support for LFM2-VL (#51498)

zupengwang committed 16 hours ago

Verified df137690

[Docs] Use incremental builds for C++ changes in `AGENTS.md` (#53098)

gau-nernst committed 17 hours ago

Verified 6259572b

Older