Commits vllm-project/vllm

Merge branch 'main' into muse-spark-support

jeejeelee committed 23 hours ago

Verified 6cc692b5

[Spec Decode] Don't reserve DFlash/DSpark draft slots in the scheduler token budget (#59468)

zixi-qi committed 23 hours ago

Verified 7cd7982d

[Model] Add Muse Spark support

jeejeelee committed 23 hours ago

a20ad026

[Bugfix] Fix Apertus streaming scientific notation (#61812)

bzsuni committed 23 hours ago

Verified 338dab07

[Bugfix][Frontend] Preserve streaming chunk boundaries in RequestOutputCollector (#58941)

sawsa307 committed 23 hours ago

Verified 957d512e

[Bugfix][Frontend] Reject Cohere REQUIRED tool choice without tools (#61825)

KuanJia committed 1 day ago

Verified a9e90b9d

[CI] Skip exited descendants when finding the worker in the FT e2e test (#61648)

okorzh-amd committed 1 day ago

Verified d6f0b7a4

[Core] Apply prefill_schedule_interval outside data parallelism (#54627)

fululi12 committed 1 day ago

Verified ed3050ad

[Perf] Fuse the mamba align block-table gather into one Triton kernel, 7 kernels -> 1, 6x speedup on all shapes for this kernel (#58737)

fululi12 committed 1 day ago

Verified c825e1d2

[UMBP][1/10] Add shared connector, runtime contracts, and request lifecycle (#61789)

charxwu committed 1 day ago

Verified a97d19d7

[Frontend] Apply each endpoint's top_logprobs cut in derender (#59518)

yinli-systems committed 1 day ago

Verified 3dcfaeb4

[ROCm][Perf] Pad fp16/bf16 GEMM weight row stride for L2 cache (#55090)

mgehre-amd committed 1 day ago

Verified 011fa68c

[Bugfix][MoE] Keep routing rows during DeepSeek V4.1 decoder replay (#61643)

Ronald1995 committed 1 day ago

Verified d12d5460

[Bugfix] Engage indexer TP row sharding on total rows, not per-rank rows (#61647)

zigzagcai committed 1 day ago

Verified 24f632ca

[Bugfix][CPU] Report the real cause when the worker outgrows its memory reservation (#59472)

mosafariuk committed 1 day ago

Verified 69425846

[Bugfix][Frontend] Leave the final stop token out of chat derender text (#61757)

khluu committed 1 day ago

Verified b7b20b1b

[MM][CG] Support ViT full CUDA graph for DeepSeek-VL2 (#46005)

littlecircle0730 committed 1 day ago

Verified 71536bd5

[ROCm][DSv4.1] Disambiguate ROCm attention class names (#58689)

tuukkjs committed 1 day ago

Verified 0951fc18

[Bugfix] Terminate streaming sessions on ABORT/ERROR and prevent zombie sessions (#58942)

sawsa307 committed 1 day ago

Verified 14635015

[Model] Support every Decision 3.0 size (d3-flash, d3-mini, d3-nano, d3-lite, d3-edge) (#61778)

Xunzhuo committed 1 day ago

Verified 766c837b

[Bugfix] Create cuBLAS handles before memory profiling to avoid OOM (#61044)

laithsakka committed 1 day ago

Verified 9cede34a

[Frontend] Replace return_mm_kwargs with an mm_payload enum on render requests (#61427)

hickeyma committed 1 day ago

Verified 252be28c

[Bugfix][Frontend] Emit kv/ec transfer params at the top level of render output (#61241)

hickeyma committed 1 day ago

Verified c6b772cf

[ROCm][DSv4] AITER MegaMoE Fixed-Slot Dispatch For DeepSeek-V4 (#61262)

micah-wil committed 1 day ago

Verified e8e1e961

[Bugfix][KV Offload] Always attempt NIXL agent removal during peer teardown (#60279)

nej1gotnochill committed 1 day ago

Verified 8b27d274

[Feature][Frontend] Control the log level of request JSON body using env var (#60630)

talorabr committed 1 day ago

Verified 81e42c99

[Bugfix][DSv4] Remap Quark MTP layer_quant_config onto draft prefixes (#56054)

jimmy-adams committed 1 day ago

Verified 365aaa77

[Core] Add PROMOTION_LATENCY histogram metric for tiering offload (#53910)

zdtsw committed 1 day ago

Verified e10c10a6

[Perf] Read VLLM_COMPUTE_NANS_IN_LOGITS once per IterationStats (#61710)

peilii committed 1 day ago

Verified 6fe7401f

[Model] Add AliceAI support (#57963)

timka-byzov committed 1 day ago

Verified 716c5225