vllm-project/vllm

Pull Requests Commits

[Core] Use `CpuGpuBuffer` for block table tensors (#24795)

njhill committed 105 days ago

Verified eeb135eb

[Doc] Add --force-overwrite option to generate_cmake_presets.py (#24375)

elvischenv committed 106 days ago

Verified 3059b9cc

Removes source compilation of nixl dependency (#24874)

bbartels committed 106 days ago

Verified 64ad5518

[FP8] Extend per-token-group quantization support to QuantFP8 (#24342)

tahsintunan committed 106 days ago

Verified cef32104

[CI] GPT-OSS GPQA eval test for Blackwell (#24920)

mgoin committed 106 days ago

Verified 493b10f8

[CI][Bugfix] Fix failing Blackwell test (#24993)

MatthewBonanni committed 106 days ago

Verified d119fc86

[Perf] Reuse workspace for FP8+FP4 Marlin MoE (#20500)

mgoin committed 106 days ago

Verified dbebb7f8

fp8 kv cache support fix for torch.compile (#22758)

maleksan85 committed 106 days ago

Verified 3053a22b

Use kwargs for long lists of `EngineCoreRequest` arguments in tests and fix extra kwargs (#24987)

qthequartermasterman committed 106 days ago

Verified 02d4b854

[gpt-oss][1][bugfix] fix streaming final output (#24466)

qandrew committed 106 days ago

Verified 86daa875

[ROCm] Add dependencies for ROCm (#24900)

Concurrensee committed 106 days ago

Verified dcf2f3ec

[MISC] Add code owners of vllm/v1 to vllm/v1/core (#24928)

heheda12345 committed 106 days ago

Verified 218454b9

[gpt-oss][1b] streaming add item id, content id (#24788)

qandrew committed 106 days ago

Verified f4d6eb95

Directly get max encoder len from VLLM config in V1 (#24866)

Sugar-zsg committed 106 days ago

Verified cd1f885b

[Misc] Add removed encoder-decoder models to previously supported models list (#24961)

Isotr0py committed 106 days ago

Verified d593cf28

[Bugfix] Fix unable to run encoder model when disable_hybrid_kv_cache_manager is true (#24571)

lianyiibo committed 106 days ago

Verified faa7a5da

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

SageMoore committed 106 days ago

Verified 56793995

[Core][MultiModalHasher] Don't convert memoryviews to bytes during hashing (#24925)

lgeiger committed 106 days ago

Verified 08369289

[Model] Clean up and simplify Mamba2 Metadata Usage in both V0 and V1 (#24331)

cyang49 committed 106 days ago

Verified 73cfb3c5

[CI] Add Decode Context Parallelism (DCP) test to CI (#24487)

minosfuture committed 106 days ago

Verified 4e5affea

(doc): set cmake c++ compatible standard when building on MacOS CPU. (#23483)

teekenl committed 106 days ago

Verified e4f0b4cd

feat: Add Grafana and Perces monitoring dashboards for vLLM (#23498)

liangwen12year committed 106 days ago

Verified de3e53a7

[Docs] move benchmarks README to contributing guides (#24820)

yeqcharlotte committed 106 days ago

Verified 85e0df13

Move `SpeculativeConfig` from `config/__init__.py` to `config/speculative.py` (#24904)

hmellor committed 106 days ago

Verified 0faf3cc3

[Feat][EPLB] A novel static EPLB placement strategy for MoE models. (#23745)

cboss6 committed 106 days ago

Verified 7ea5c73a

[Mamba] Support TP>1 with quantization for mamba2 mixer in case `n_groups % tp_size == 0` (#24593)

tomeras91 committed 106 days ago

Verified 27fcfe7b

[Bugfix] remove duplicate tokens streamed in required tool choice streaming (#23312)

Jason-CKY committed 106 days ago

Verified 68dbde5d

[benchmark] Add triton version in the moe tuned config (#24769)

jeejeelee committed 106 days ago

Verified 04ad0dc2

[QWEN NEXT] Fused MoE kernels Optimization configs (#24924)

samanamp committed 106 days ago

Verified 238c4c17

[Bug] [Spec Dec]: Fix kv_cache dtype mismatch for Eagle3 drafter on FP8 target (#24505)

vllmellm committed 106 days ago

Verified 8c546102

Newer Older