vllm-project/vllm

Pull Requests Commits

Cold-scope marker for network-dimension run

khluu committed 53 days ago

bea4d505

Sample ENA allowance counters, socket usage, and conntrack occupancy

khluu committed 53 days ago

1be39095

Detach baseline sampler with setsid and add foreground upload probe

khluu committed 53 days ago

3f2022e2

Ship baseline samples as artifacts with shipping diagnostics kept

khluu committed 53 days ago

7ce7dda1

Ship baseline samples via annotation so evidence survives log-pipe closure and agent loss

khluu committed 53 days ago

b259a893

Extend baseline sampler with CPU utilization, cgroup accounting, and network counters

khluu committed 53 days ago

2043b78a

Add diagnostic heartbeat sampler hook for CPU image build baseline

khluu committed 53 days ago

bae661c3

[Rust Frontend] Replace external `protoc` with pure Rust lib `protox` (#52892)

BugenZhao committed 53 days ago

Verified 83c5d592

[Bugfix][Spec Decode] Scope DSpark backend inheritance to DeepSeek V4 (#52809)

mgoin committed 53 days ago

Verified 91a893de

[Bugfix] Load untied Gemma LM head weights (#53170)

khluu committed 54 days ago

Verified d29f7f5c

[Rust Frontend] Support `--generation-config vllm` (#53044)

BugenZhao committed 54 days ago

Verified f32b17b6

[CI][Docker] Pin remaining manylinux builder images (#53172)

khluu committed 54 days ago

Verified 0a5a5513

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)

matthewkotila committed 54 days ago

Verified 7cfb97e3

Fix seed loss when batch contains unseeded requests (#51866)

MKQuantum committed 54 days ago

Verified 2f41c894

[CI][Docker] Pin manylinux2_28-builder:cuda13.0 to the release/2.13 image (#52994)

atalman committed 54 days ago

Verified 54ba80d9

[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989)

mgoin committed 54 days ago

Verified bfb6c134

[DSV4][Kernel] Fuse shared experts into MegaMoE (#53040)

gcanlin committed 54 days ago

Verified 4f6885ff

[CI/Build][ROCm] Keep the CUDA-only kernel tests out of the ROCm run (#53113)

stefankoncarevic committed 54 days ago

Verified 3b829cf1

[Bugfix] Support MistralCommonBackend tokenizers in structured output (#52720)

thanhpt1110 committed 54 days ago

Verified d56bbf39

[Bugfix][MiniMax-M3] Keep FP8 query allocation stable across CUDA graph replay (#51203)

kyleliang-nv committed 54 days ago

Verified 7c8b68b9

[Misc] Don't allow language-model-only used with encoder CG together (#53127)

Isotr0py committed 54 days ago

Verified 00f7f258

upgrade tpu-inference to v0.27.0 (#53088)

meiyeh123 committed 54 days ago

Verified ae256289

Reduce `AutoWeightsLoader` kwargs (#53106)

hmellor committed 54 days ago

Verified 1fe3a157

Fix Transformers modelling backend `RMSNormFuser.fuse` performance (#52766)

hmellor committed 54 days ago

Verified 2dd17225

[Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)

zupengwang committed 54 days ago

Verified 01af92e1

[Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)

Yiqin-17 committed 54 days ago

Verified cb09dd74

[Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204)

seonjinn committed 54 days ago

Verified bd8865a2

[Bugfix] Skip MM processor cache inserts larger than capacity (#53016)

Prudhvivuda committed 54 days ago

Verified de216b6e

[Docker] Update to nixl-1.3.2 (#51777)

sandeep-maddipatla committed 54 days ago

Verified 4b7cb949

[Model] Add tower and connector LoRA support for LFM2-VL (#51498)

zupengwang committed 54 days ago

Verified df137690

Older