vllm-project/vllm

Pull Requests Commits

Read ENA allowance counters via SIOCETHTOOL ioctl without ethtool binary

khluu committed 22 days ago

de19db10

Install ethtool for ENA allowance counters with foreground probe

khluu committed 22 days ago

d64b4b10

Sample ENA allowance counters, socket usage, and conntrack occupancy

khluu committed 23 days ago

1be39095

Detach baseline sampler with setsid and add foreground upload probe

khluu committed 23 days ago

3f2022e2

Ship baseline samples as artifacts with shipping diagnostics kept

khluu committed 23 days ago

7ce7dda1

Ship baseline samples via annotation so evidence survives log-pipe closure and agent loss

khluu committed 23 days ago

b259a893

Extend baseline sampler with CPU utilization, cgroup accounting, and network counters

khluu committed 23 days ago

2043b78a

Add diagnostic heartbeat sampler hook for CPU image build baseline

khluu committed 23 days ago

bae661c3

[Rust Frontend] Replace external `protoc` with pure Rust lib `protox` (#52892)

BugenZhao committed 23 days ago

Verified 83c5d592

[Bugfix][Spec Decode] Scope DSpark backend inheritance to DeepSeek V4 (#52809)

mgoin committed 23 days ago

Verified 91a893de

[Bugfix] Load untied Gemma LM head weights (#53170)

khluu committed 23 days ago

Verified d29f7f5c

[Rust Frontend] Support `--generation-config vllm` (#53044)

BugenZhao committed 23 days ago

Verified f32b17b6

[CI][Docker] Pin remaining manylinux builder images (#53172)

khluu committed 23 days ago

Verified 0a5a5513

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)

matthewkotila committed 23 days ago

Verified 7cfb97e3

Fix seed loss when batch contains unseeded requests (#51866)

MKQuantum committed 23 days ago

Verified 2f41c894

[CI][Docker] Pin manylinux2_28-builder:cuda13.0 to the release/2.13 image (#52994)

atalman committed 23 days ago

Verified 54ba80d9

[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989)

mgoin committed 23 days ago

Verified bfb6c134

[DSV4][Kernel] Fuse shared experts into MegaMoE (#53040)

gcanlin committed 23 days ago

Verified 4f6885ff

[CI/Build][ROCm] Keep the CUDA-only kernel tests out of the ROCm run (#53113)

stefankoncarevic committed 23 days ago

Verified 3b829cf1

[Bugfix] Support MistralCommonBackend tokenizers in structured output (#52720)

thanhpt1110 committed 23 days ago

Verified d56bbf39

[Bugfix][MiniMax-M3] Keep FP8 query allocation stable across CUDA graph replay (#51203)

kyleliang-nv committed 23 days ago

Verified 7c8b68b9

[Misc] Don't allow language-model-only used with encoder CG together (#53127)

Isotr0py committed 23 days ago

Verified 00f7f258

upgrade tpu-inference to v0.27.0 (#53088)

meiyeh123 committed 23 days ago

Verified ae256289

Reduce `AutoWeightsLoader` kwargs (#53106)

hmellor committed 23 days ago

Verified 1fe3a157

Fix Transformers modelling backend `RMSNormFuser.fuse` performance (#52766)

hmellor committed 23 days ago

Verified 2dd17225

[Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)

zupengwang committed 23 days ago

Verified 01af92e1

[Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)

Yiqin-17 committed 23 days ago

Verified cb09dd74

[Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204)

seonjinn committed 23 days ago

Verified bd8865a2

[Bugfix] Skip MM processor cache inserts larger than capacity (#53016)

Prudhvivuda committed 23 days ago

Verified de216b6e

[Docker] Update to nixl-1.3.2 (#51777)

sandeep-maddipatla committed 23 days ago

Verified 4b7cb949

Older