vllm-project/vllm

Pull Requests Commits

Disabled DeepGEMM -> batched triton fallback by default

tlrmchlsmth committed 30 days ago

53fa4c6a

[CI][ROCm][tests/v1/e2e] Fix multiprocessing launch for the test (#29123)

divakar-amd committed 30 days ago

Verified afb1e5b3

Fix boolean nested params, add dict format support, and enhance plotting for vllm bench sweep (#29025)

Copilot committed 30 days ago

Verified 1c593e11

feat(model): Add BitsAndBytes quantization support for Qwen3-Omni-MoE (#29896)

Navanit-git committed 30 days ago

Verified a2b053dc

[Attention][CUDAGraph] Remove CG padding from attention backends (#29352)

MatthewBonanni committed 30 days ago

Verified 1d93f116

[CI/Build] Fixes missing runtime dependencies (#29822)

bbartels committed 30 days ago

Verified 2d613de9

Update AMD-CI testing mirror (as of 2025-12-02) (#29898)

Alexei-V-Ivanov-AMD committed 30 days ago

Verified c77b9929

[Chore]: Reorganize gguf utils funtions under `transformers_utils` (#29891)

Isotr0py committed 30 days ago

Verified 63b1da76

[responsesAPI][3] ResponsesParser to set up non harmony MCP (#29413)

qandrew committed 30 days ago

Verified 52cb349f

[Bugfix] Fix incorrect channel order for idefics3 in edge case (#29881)

Isotr0py committed 30 days ago

Verified 0ec84221

[examples] Resettle pooling examples. (#29365)

noooop committed 30 days ago

Verified 2eb4fe91

[Bugfix] Fix DeepSeek R1 MTP weight loading (#29545)

MatthewBonanni committed 30 days ago

Verified 51c57b51

[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image bytes instead of pixel values (#29621)

ImaGoodFella committed 30 days ago

Verified 60c3d413

[Chore] Use `tokenizer.encode` and `tokenizer.decode` directly (#29851)

DarkLight1337 committed 30 days ago

Verified 68ffbca7

Remove default values from `InitVar`s so that they're not stored (#29859)

hmellor committed 30 days ago

Verified 951445a5

Add Mistral Large 3 and Ministral 3 (#29757)

juliendenize committed 30 days ago

Verified d8c6210e

[vLLM Benchmark Suite] Add default parameters section and update CPU benchmark cases (#29381)

louie-tsai committed 30 days ago

Verified 8bbcf8b6

[BugFix] add max-num-batched-token to scheduler hash (#29829)

BoyuanFeng committed 30 days ago

Verified 70fb77b4

[CI] Fix Bad_words test for tokenizer encode/decode asymmetry (#28193)

zhyajie committed 30 days ago

Verified 48d15a32

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

BoyuanFeng committed 30 days ago

Verified 3b221cb6

[Core] Eliminate redundant is_encoder_decoder lookups (20-40us/step) (#29800)

wushidonguc committed 30 days ago

Verified 0037b574

Fix some Transformers nightly tests (#29802)

hmellor committed 30 days ago

Verified f5b0846b

[CPU]Parallelize over tokens in int4 moe (#29600)

xiangze-arm committed 30 days ago

Verified 13ea39bc

[CI] Renovation of nightly wheel build & generation (take 2) (#29838)

Harry-Chen committed 30 days ago

Verified 4b612664

[Chore] Move tokenizer initialization methods (#29793)

DarkLight1337 committed 30 days ago

Verified 653591d5

[CI][AMD] spec_decode:eagle skip FLASH_ATTN for deepseek on ROCm (#29827)

divakar-amd committed 30 days ago

Verified e2fbfc95

[CI][ROCm] Fix test_correctness_sliding_window (#29243)

divakar-amd committed 30 days ago

Verified a690fb5b

[BugFix] Fix index error in ngram_proposer (#29779)

usberkeley committed 30 days ago

Verified 81fe3f82

[Misc] Update conftest for entrypoints/sagemaker test folder (#29799)

zhaozuy committed 30 days ago

Verified 53bf71b0

Add missing return in _check_vllm_model_embed_input_ids (#29834)

jcyang43 committed 30 days ago

Verified f441d36c

Older