vllm-project/vllm

Pull Requests Commits

Add .deps to .dockerignore

tlrmchlsmth committed 61 days ago

74e803fd

[ROCm][CI] Pin TorchCodec to v0.10.0 for ROCm compatibility (#34447)

AndreasKaratzas committed 61 days ago

Verified 4c078fa5

[Voxtral Realtime] Refactor & Improve buffering logic (#34428)

patrickvonplaten committed 61 days ago

Verified 6c0baee6

[Voxstral Realtime] Enable tests (#33803)

patrickvonplaten committed 61 days ago

Verified 1100a976

[ROCm][quantization] improve OCP weight quant parser robust (#34431)

xuebwang-amd committed 61 days ago

Verified 766e1678

[Bugfix] Remove broken raw url GGUF model loading support (#34433)

Isotr0py committed 61 days ago

Verified becbe248

Fix MoE for the Transformers modelling backend (#34436)

hmellor committed 61 days ago

Verified 679ca5d8

[Attention] Add FlashInfer Sparse MLA backend (#33451)

MatthewBonanni committed 61 days ago

Verified f2c47886

[Docs] Spec decoding docs warning removal (#34439)

NickLucche committed 61 days ago

Verified 334c715e

[BUG] Reset running requests when clearing cache for pause/resume (#34382)

hao-aaron committed 61 days ago

Verified 7b5a8b4a

Add config file for fused MoE for Nemotron (TP4, B200) (#34411)

danisereb committed 61 days ago

Verified dea63512

[ROCm] Enable MXFP4 MoE weight pre-shuffling on gfx950 and update aiter (#34192)

dllehr-amd committed 61 days ago

Verified 8a798be9

[V0 Deprecation] Remove code related to per-request logits processors (#34400)

DarkLight1337 committed 61 days ago

Verified fb455ed5

Fix Mistral config remap to accept compressed-tensors quantization #34028 (#34104)

baonudesifeizhai committed 61 days ago

Verified f5897613

Vllm CPU benchmark suite improvement (#34128)

louie-tsai committed 61 days ago

Verified 55a1a956

[bugfix] refactor FunASR's _get_data_parser (#34397)

AllenDou committed 61 days ago

Verified 386bfe5d

[Bugfix] Fix Sparse24 Compressed Tensors models (#33446)

kylesayrs committed 61 days ago

Verified e9cd6911

Fix DeepSeek-OCR tensor validation for all size variants (#34085)

yichuan-w committed 61 days ago

Verified 80f2ba6e

[BugFix] Fix DP chunking (#34379)

LucasWilkinson committed 61 days ago

Verified 136b0bfa

[Refactor] Pass Renderer to Input Processor (#34329)

DarkLight1337 committed 61 days ago

Verified b96f7314

[Refactor] Move validation to params definitions (#34362)

DarkLight1337 committed 61 days ago

Verified ced2a92f

[Bug Fix] Fix `naive_block_assignment` always defaulting to False due to arg misalignment (#33848)

RunkaiTao committed 61 days ago

Verified e1d97c38

[Bugfix] Fix MTP accuracy for GLM-5 (#34385)

mgoin committed 61 days ago

Verified ec12d39d

[Refactor] Replace `activation: str` with `MoEActivation` enum (#33843)

mgoin committed 61 days ago

Verified ff1f83b0

[ci] Integrate AMD tests into CI (#33626)

khluu committed 61 days ago

Verified 83b47f67

[ROCm][CI] Revert Test Groups From mi325_8 to mi325_1 Agent Pool In AMD CI (#34384)

micah-wil committed 61 days ago

Verified fb7b30c7

[Bugfix] Fix some issues with MoERunner PR #32344 (#34371)

bnellnm committed 61 days ago

Verified 31d992d2

Fix CI failure - Flashinfer Kernel tests (#34316)

wzhao18 committed 61 days ago

Verified 5aff2699

[Bugfix] Fix more multimodal tests for transformers V5 (#34334)

zucchini-nlp committed 61 days ago

Verified 527ca321

[Bugfix] send None sentinel on final commit so server properly sends transcription.done (#33963)

pjs102793 committed 61 days ago

Verified 5458eb83

Older