vllm-project/vllm

Pull Requests Commits

yewentao256 committed 45 days ago

902ebda3

[NIXL][Bugfix] Failure logging overhaul + early metadata free on failure (#32031)

NickLucche committed 45 days ago

Verified f8bd8394

[Model Runner V2] Support logit_bias, allowed_token_ids, min_tokens (#32163)

WoosukKwon committed 45 days ago

Verified ca81811b

[Misc][BE] Type coverage for vllm/compilation [3/3] (#31748)

Lucaskabela committed 45 days ago

Verified ad8818bb

[Misc] Change log level for batch queue log (#32192)

NickLucche committed 45 days ago

Verified 08e8e99c

[BugFix] scheduler: Fix ordering preserving of skipped requests (#32173)

orozery committed 45 days ago

Verified 2be765b6

[Misc] Set default torch num threads for input processing (#31879)

ywang96 committed 45 days ago

Verified 16abe6b8

[Refactor] EPLB rebalance algo to NumPy (#30697)

ilmarkov committed 45 days ago

Verified 1eb61ab3

[BugFix] fix FusedMoE.make_expert_params_mapping in EXAONE-MoE (#32196)

lkm2835 committed 45 days ago

Verified 3d962d72

[3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054)

MatthewBonanni committed 45 days ago

Verified 20228cb8

[Benchmark] Share data between SLA runs (#32184)

DarkLight1337 committed 45 days ago

Verified 7c0d3c51

[Misc][PD] Fix `get_attn_backend` usage in transfer connectors (#31988)

NickLucche committed 45 days ago

Verified 5b681074

[Bugfix] Fix stale SSM state for new Mamba requests scheduled as decode (#32118)

Josephasafg committed 45 days ago

Verified 8fb2c135

[Model] Standardize pooling heads (#32148)

DarkLight1337 committed 45 days ago

Verified 8863c2b2

[FIX] Add NO_MUL activation support for modular kernel path (#31528)

danielafrimi committed 45 days ago

Verified 3f72639d

[MODEL] New model support for kakaocorp/kanana-1.5-v-3b-instruct (#29384)

kakao-steve-ai committed 45 days ago

Verified 6bc9c847

Add K-EXAONE-236B-A23B (#31621)

lkm2835 committed 45 days ago

Verified 63ed2409

doc: Update model references in supported_models.md (#32188)

andyzhangx committed 45 days ago

Verified 95e53d90

[ROCm] [Bugfix] Fix order of mori build in Dockerfile.rocm_base (#32179)

tjtanaa committed 45 days ago

Verified 0346396e

doc: Update model name for Qwen3-Coder in documentation (#32185)

andyzhangx committed 45 days ago

Verified e68b0dad

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)

orozery committed 45 days ago

Verified 9cddbdba

[Feature] Support recording expert indices for rollout router replay (#28284)

xhx1022 committed 45 days ago

Verified 49e6b86c

[P/D] Refactor mooncake connector sender thread using async coroutines (#31573)

dtcccc committed 45 days ago

Verified 0565f1fd

[Bugfix] Fix missing scale passing for encoder Triton Attention implementation (#32149)

Isotr0py committed 46 days ago

Verified 9dbe1fe9

[Doc] Add documentation for offline API docs feature (#32134)

ricky-chaoju committed 46 days ago

Verified a5f89ae2

[Doc] Improve LoRA docs (#32159)

jeejeelee committed 46 days ago

Verified 05e89812

[doc] fix broken links (#32158)

minimAluminiumalism committed 46 days ago

Verified 899541bd

[Frontend] Fix Flaky MCP Streaming Test (#32153)

daniel-salib committed 46 days ago

Verified d7b2e570

[cpu][bench] Add Fused MoE Micro Benchmark for CPU Backend (#32092)

andikarachman committed 46 days ago

Verified 5e034f2e

[Misc] Disable default `--ready-check-timeout-sec` extra call in vllm bench (#30975)

NickLucche committed 46 days ago

Verified 22970c16

Older