Commits vllm-project/vllm

[Bugfix] Fix /moe/test_flashinfer.py

tlrmchlsmth committed 185 days ago

05a556cf

[CI][Nixl] Add CrossLayer KV layout tests (#34615)

NickLucche committed 185 days ago

Verified 8e962fef

[Renderer] Move InputPreprocessor into Renderer (2/2) (#34560)

DarkLight1337 committed 185 days ago

Verified 574fe752

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514)

junuxyz committed 185 days ago

Verified c61a98f5

Fix docs build warning (#34686)

hmellor committed 185 days ago

Verified 28bffe94

[Bugfix] Fix 'remove_instance_endpoint' method logic in disagg_proxy_demo (#32922)

ChenqianCao committed 185 days ago

Verified ad65177a

Remove dead bitsandbytes CxB code from 8-bit inference path (#34633)

TimDettmers committed 185 days ago

Verified d44a5b6c

Revert "[Models] Fuse Qwen3.5 GDN's qkvz_proj and ba_proj" (#34683)

ZJY0516 committed 185 days ago

Verified 1d65283e

[Ray] Propagate third-party env vars to Ray workers via prefix matching (#34383)

kouroshHakha committed 185 days ago

Verified c464b573

[CI] Fix bake config artifact path for AMI rebuild pipeline (#34656)

Amr Mahdi committed 185 days ago

Verified c5c38e15

[Model Runner V2] Minor refactoring for penalties (#34662)

WoosukKwon committed 185 days ago

Verified d00df624

[Model Runner V2] Minor simplification for BadWordsState (#34669)

WoosukKwon committed 185 days ago

Verified 9752da9d

[Model Runner V2] Minor cleanup for PP (#34666)

WoosukKwon committed 185 days ago

Verified 04925b22

[Model Runner V2] Fix unintended CPU-GPU sync in make_dummy (#34667)

WoosukKwon committed 185 days ago

Verified d74278fb

[Bugfix] Fix fused MoE int32 overflow in stride*offset without perf regression (#34507)

haosdent committed 185 days ago

Verified b68fd899

[CI] Enable mypy import following for vllm/v1/kv_offload (#34639)

aneeshkp committed 185 days ago

Verified 0b5f9b72

[Core] Pipeline Parallel support for Model Runner V2 (#33960)

ZhanqiuHu committed 185 days ago

Verified 9a8853f7

[Model Runner V2] support bad_words sampling param (#33433)

izhuhaoran committed 185 days ago

Verified 387a1898

[NemotronH] Do not force router to run in fp32 (#34582)

roikoren755 committed 186 days ago

Verified 3b30e615

Targeting the MI355 agent pool with all existing tests (#34629)

Alexei-V-Ivanov-AMD committed 186 days ago

Verified 824f9e8f

[Bugfix][CI] Fix flaky `entrypoints/openai/test_response_api_with_harmony.py::test_function_calling[openai/gpt-oss-20b]` (#34624)

NickLucche committed 186 days ago

Verified 6cc403e6

[Bugfix] Treat generation_config max_tokens as default not ceiling (#34063)

almogtavor committed 186 days ago

Verified 72d5951d

[CI] Enable mypy coverage for individual excluded files (#34292)

Lucaskabela committed 186 days ago

Verified a3205bef

(bugfix): Fixed encode in LLM entrypoint for IOProcessr plugin prompts (#34618)

christian-pinto committed 186 days ago

Verified 6930becd

[ROCm][CI] Fix plugins test group; updating terratorch and dependencies (#34589)

AndreasKaratzas committed 186 days ago

Verified 03a8770a

[Bugfix] Fix ARC touch KeyError for non-ready T1 blocks in kv offload (#34576)

Vivo50E committed 186 days ago

Verified bc56a1d5

Fix call to moe_mk in modelopt MoE modules (required for LoRA) (#34575)

danisereb committed 186 days ago

Verified ec7d9e67

[Models] Fuse Qwen3.5 GDN's qkvz_proj and ba_proj (#34492)

Isotr0py committed 186 days ago

Verified 3bb4e431

[CI] Disable precompiled wheel path in CI image builds (#34606)

Amr Mahdi committed 186 days ago

Verified 08f8c198

Bump `lm-eval` version for Transformers v5 compatibility (#33994)

hmellor committed 186 days ago

Verified a21cedf4