vllm-project/vllm

Pull Requests Commits

njhill committed 166 days ago

5c2a80c3

fix dp plus full cuda-graph

LucasWilkinson committed 166 days ago

844022b1

[Bugfix] Make async scheduling compatible with DP

WoosukKwon committed 166 days ago

ff6c72db

[BugFix] Improve internal DP load balancing

njhill committed 166 days ago

8f731cf3

[P/D] Log warnings related to prefill KV expiry

njhill committed 166 days ago

a46c1de7

[BugFix] Harden coordinator startup

njhill committed 166 days ago

ca11caf5

[`Ernie 4.5`] Name Change for Base 0.3B Model (#21735)

vasqu committed 166 days ago

Verified 656c24f1

[PD] let p2p nccl toy proxy handle /chat/completions (#21734)

chaunceyjiang committed 166 days ago

Verified 63fe3a70

[Bugfix] Fix glm4.1v video_grid_thw tensor shape scheme (#21744)

Isotr0py committed 166 days ago

Verified 0ae970ed

[Bugfix] Fix environment variable setting in CPU Dockerfile (#21730)

bigPYJ1151 committed 166 days ago

Verified 65e8466c

[Bugfix] Fix Ernie4_5_MoeForCausalLM shared experts (#21717)

jeejeelee committed 166 days ago

Verified 1b769dcc

[feature] add log non default args in LLM (#21680)

lengrongfu committed 166 days ago

Verified 2cc57119

[Model] Prioritize Transformers fallback over suffix matching (#21719)

DarkLight1337 committed 166 days ago

Verified a4ed7315

Migrate KeyeImageInputs and KeyeVideoInputs to TensorSchema (#21686)

bbeckca committed 166 days ago

Verified d128d0d5

[v1][mamba] Added mamba_type into MambaSpec (#21715)

Josephasafg committed 166 days ago

Verified a6c05028

[BugFix] Fix ChunkedLocalAttention when the hybrid kv-cache is disabled (#21707)

LucasWilkinson committed 166 days ago

Verified 139a7f07

[Bugfix] fix max-file-size type from str to int (#21675)

andyxning committed 166 days ago

Verified 150d9e63

[Bugfix] Fix shape checking for Fuyu (#21709)

DarkLight1337 committed 166 days ago

Verified 139a97ec

[bugfix] fix profile impact benchmark results (#21507)

lengrongfu committed 166 days ago

Verified 18cc33dd

[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named function calling when Thinking is disabled (#21573)

hsliuustc0106 committed 166 days ago

Verified 7656cf4c

Migrate Idefics3ImagePixelInputs and Idefics3ImageEmbeddingInputs to … (#21683)

bbeckca committed 166 days ago

Verified 3ea57a56

Migrate GraniteSpeechAudioInputs to TensorSchema (#21682)

bbeckca committed 166 days ago

Verified 75856bc2

Migrate GLMVImagePixelInputs to TensorSchema (#21679)

bbeckca committed 166 days ago

Verified 304dcdf5

Migrate Glm4vImageInputs, Glm4vVideoInputs to TensorSchema (#21678)

bbeckca committed 166 days ago

Verified 88e46c7c

Migrate Gemma3ImagePixelInputs to TensorSchema (#21676)

bbeckca committed 166 days ago

Verified d8937de4

[FEAT] [ROCm] [AITER]: Add AITER HIP block quant kernel (#21242)

tjtanaa committed 166 days ago

Verified e626d286

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674)

Alnusjaponica committed 166 days ago

Verified c7ffe93d

[V1] Exception Handling when Loading KV Cache from Remote Store (#21534)

liuyumoye committed 166 days ago

Verified 15a72ac4

[Misc] Add fused_moe configs for Qwen3-Coder-480B-A35B-Instruct-FP8 (#21700)

jeejeelee committed 166 days ago

Verified 04ff4be3

Fix GLM tool parser (#21668)

zRzRzRzRzRzRzR committed 166 days ago

Verified 93269bb4

Older