vllm-project/vllm

Pull Requests Commits

[Bugfix] Fix DeepSeek v3.2 tokenizer outputting None issue (#33832)

wzhao18 committed 1 day ago

Verified 91a07ff6

Adds padding and perf improvements to wvSplitK_fp8 (#33527)

amd-hhashemi committed 1 day ago

Verified d5c48001

[Minor] Sort safetensors files to ensure deterministic loading order (#33491)

Lumosis committed 1 day ago

Verified 42d5d705

[Bugfix] Make MM batching more robust (#33817)

DarkLight1337 committed 2 days ago

Verified 116880a5

[Bugfix] Fix DSV3.2 NVFP4 (#33932)

MatthewBonanni committed 2 days ago

Verified 4145e50d

[Misc] Rename `translations` to `speech_to_text` for OAI serving component (#33904)

NickLucche committed 2 days ago

Verified 20f5d185

Fix tokenizer test for renamed attr on Transformers v5 (#33902)

hmellor committed 2 days ago

Verified 1887acca

[Bugfix] Suppress non-TTY color output on the process name part of the log (#29714)

a4lg committed 2 days ago

Verified 92e7562a

[Models] Consolidate Deepseek-OCR2 processor (#33909)

Isotr0py committed 2 days ago

Verified 87d0d17a

[Moe Refactor] Make Inplace Flag for FusedMoEModularKernel part of the constructor (#33375)

bnellnm committed 2 days ago

Verified a57c8228

[Bugfix] Fix swapped engine_ids in NIXL Llama 4 local attention path (#33795)

zackyoray committed 2 days ago

Verified 1ee95841

[Misc] Add debug logs (#33931)

NickLucche committed 2 days ago

Verified 7d8c6804

[Spec Decode] Unified Parallel Drafting (#32887)

benchislett committed 2 days ago

Verified af3162d3

[BugFix] Fix LoRA Fp8 (#33879)

danisereb committed 2 days ago

Verified 5b2a9422

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943)

hao-aaron committed 2 days ago

Verified c1858b7e

[Bugfix] Fix step3p5 parser when using mtp (#33690)

mariohong128 committed 2 days ago

Verified 82914d2a

[Docs] Add bart-plugin to docs (#33905)

NickLucche committed 2 days ago

Verified 81a90e52

[Bugfix] Fix corner case of sparse embedding (#33886)

noooop committed 2 days ago

Verified 1c3a221d

[Refactor] Clean up input preprocessing (#33687)

DarkLight1337 committed 2 days ago

Verified 7bd42e60

[Bugfix] Fix Kimi-K2.5 NVFP4 checkpoints weight loading (#33876)

Isotr0py committed 2 days ago

Verified a2522839

[perf] Integrate flashinfer concat_mla_k (#31171)

jiahanc committed 2 days ago

Verified 59a5cb38

Enable Cross layers KV cache layout at NIXL Connector V2 (#33339)

liranschour committed 2 days ago

Verified 8322d4e4

[ROCm][Bugfix][CI] Fix hybrid models and their tests (Mamba/Jamba/Bamba) (#32710)

AndreasKaratzas committed 2 days ago

Verified 3e472e81

[Refactor] Move `task` outside of `PoolingParams.verify` (#33796)

DarkLight1337 committed 2 days ago

Verified 038914b7

[Bugfix] Kimi-K2 grouped_topk usage for Flashinfer monolithic kernels. (#33858)

pavanimajety committed 2 days ago

Verified d2f4a71c

[KV Connector][Metrics] Do not count local prefix cache hits in connector queries (#30522)

markmc committed 2 days ago

Verified 2abd9759

[Perf] Optimize the performance of structured output + reasoning (#33557)

chaunceyjiang committed 2 days ago

Verified 6abb0454

[CI/Build] Fix CPU CI test case title (#33870)

bigPYJ1151 committed 2 days ago

Verified db6f71d4

[CPU][BugFix] Allow w8a8 oneDNN quantized matmul to support 3D inputs (#33727)

fadara01 committed 2 days ago

Verified fd03538b

[Bugfix] Fix ScoreMultiModalParam multi-document scoring returning single result (#33837)

AndreasKaratzas committed 2 days ago

Verified 1f70313e

Older