vllm-project/vllm

Pull Requests Commits

Add pandas and datasets for benchmarks

simon-mo committed 188 days ago

9a76ef07

Add DeepSeek-R1-0528 function call chat template (#18874)

Xu-Wenqing committed 188 days ago

Verified 02658c2d

[CI/Build][Bugfix] Ensure compatibility with transformers 4.52 (#18678)

DarkLight1337 committed 188 days ago

Verified 01dc9a76

Improve the output precision of embedding models (#19092)

noooop committed 188 days ago

Verified 35cf32df

[Misc] Add packages for benchmark as extra dependency (#19089)

Isotr0py committed 188 days ago

Verified 8711bc5e

Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113)

eicherseiji committed 188 days ago

Verified 2669a0d7

[TPU] Skip hanging tests (#19115)

lsy323 committed 188 days ago

Verified 8e972d9c

Fix #19130 (#19132)

princepride committed 188 days ago

Verified 3336c8cf

[Bugfix] Fix FA3 full cuda graph correctness (#19106)

WoosukKwon committed 188 days ago

Verified b124e108

[NVIDIA] Add Cutlass MLA backend (#17625)

kaixih committed 188 days ago

Verified 41aa5784

[Cleanup][v1]:remote guided-decoding-backend for example (#19059)

calvin0327 committed 188 days ago

Verified 8d646c2e

[KERNEL] Sampler. CUDA kernel for applying repetition penalty (#18437)

vadiklyutiy committed 188 days ago

Verified 5d6d1adf

[Core] Cast multimodal input in hf processor (#18862)

lgeiger committed 188 days ago

Verified 1409ef91

[CPU] V1 support for the CPU backend (#16441)

bigPYJ1151 committed 188 days ago

Verified 4555143e

[Docs] Add developer doc about CI failures (#18782)

russellb committed 188 days ago

Verified 52dceb17

[Misc] Fix path and python alias errors in disagg_prefill exmaples (#18919)

Jeffwan committed 188 days ago

Verified abd7df2f

feat: add data parallel rank to KVEventBatch (#18925)

PeaBrane committed 188 days ago

Verified b712be98

[Bugfix] Max concurrency estimation and check_enough_kv_cache_memory for models with sliding window layers (#19029)

heheda12345 committed 188 days ago

Verified a8da78ea

[Bugfix][P/D] Fix Prefix Cache Bug (#18411)

NickLucche committed 188 days ago

Verified 5d96533e

[Bugfix]: Fix the incompatibility issue with tool_choice 'required' when Thinking is enabled (#19075)

chaunceyjiang committed 188 days ago

Verified 4de790fc

[Bugfix] get_num_blocks_to_allocate with null_block (#19031)

heheda12345 committed 188 days ago

Verified b5fd9506

[V1][Spec Decode][Ngram] 1.35x gain -> 1.95x gain on InstructCoder with prompt fix (#18971)

ekagra-ranjan committed 188 days ago

Verified 135cf55c

[v1] Re-init input batch for multiple kv cache groups (#18654)

heheda12345 committed 188 days ago

Verified 6cac54f4

Fix interaction between `Optional` and `Annotated` in CLI typing (#19093)

hmellor committed 188 days ago

Verified 6865fe00

[Perf] Tune `scaled_fp8_quant` by increasing vectorization (#18844)

mgoin committed 188 days ago

Verified e31446b6

[V1] Support cross-layer KV sharing (#18212)

sarckk committed 188 days ago

Verified bdf13965

[Kernel] DeepEP dispatch-combine kernel integration (#18434)

varun-sundar-rabindranath committed 188 days ago

Verified fa98d777

[doc] update docker version (#19074)

reidliu41 committed 188 days ago

Verified 01eee405

[Doc] Readme standardization (#18695)

SorenDreano committed 188 days ago

Verified 19bdaf32

[Misc] Add SPDX-FileCopyrightText (#19100)

simon-mo committed 188 days ago

Verified 02f0c7b2

Older