vllm-project/vllm

Pull Requests Commits

fix kimi dtype issue

yewentao256 committed 19 hours ago

e700f2ad

[CI][Examples][RLHF] Disable async scheduling in rlhf_async_new_apis (#42042)

haosdent committed 22 hours ago

Verified 52458b60

Make docs environment deterministic (#41926)

hmellor committed 1 day ago

Verified 630820a5

[CI][XPU]Ignore some lora tests from LoRA Intel CI pipeline (#42010)

chaojun-zhang committed 1 day ago

Verified 19df11f5

[CI][Bugfix] Drop duplicated examples/ prefix in tensorize_vllm_model command (#42039)

haosdent committed 1 day ago

Verified 36b2c79d

[CI][Bugfix] Surface subprocess output in spawn_new_process_for_each_test (#41943)

haosdent committed 1 day ago

Verified 160858cb

[CI][ROCm] Ship RIXL with `vllm/vllm-openai-rocm` (#41634)

simondanielsson committed 1 day ago

Verified f9b9bf3b

[Bugifx] Missing Renderer for `fastokens` mode (#41984)

tjtanaa committed 1 day ago

Verified 445d7474

[Docs] Reorganize examples docs. (#41082)

noooop committed 1 day ago

Verified 77b13b96

[Aiter][ROCm] gdn_linear_attn kernel fusion (#40711)

tpopp committed 1 day ago

Verified ed582b6a

[Bugfix] Fix XPU/ROCm compatibility in spawn_new_process_for_each_test (#41895)

dzhengAP committed 1 day ago

Verified 1acd67a7

[Kernel][Helion] Optimize Helion config parsing latency (#40850)

gmagogsfm committed 1 day ago

Verified 0b999713

enable persistent mla for sparse mla backend (#41990)

dllehr-amd committed 1 day ago

Verified baf068d8

fix: default TILELANG_CLEANUP_TEMP_FILES=1 to avoid shared /tmp conflicts (#41486)

ssam18 committed 1 day ago

Verified 01b0f3ad

[Perf][3/n] Eliminate GPU<->CPU syncs in attention impls (#41434)

njhill committed 1 day ago

Verified 989c176c

[Perf] Use numpy zero-copy path for embedding float response serialization (#41681)

lokashrinav committed 1 day ago

Verified cd58e308

[Examples][last/6] Resettle examples. (#41084)

noooop committed 1 day ago

Verified 1d694e78

[CI][Bugfix] Fix CI failures for "PyTorch Compilation Unit Tests" (#41940)

haosdent committed 1 day ago

Verified 57c2f724

[CI][Bugfix] Fix failure CI step "PyTorch Fullgraph Smoke Test" (#41953)

haosdent committed 1 day ago

Verified 5f6a0281

add: LFM2/2.5 Tool Parser (#39243)

jbuchananr committed 1 day ago

Verified 50f2db25

[KV Connector] Opt DecodeBenchConnector into SupportsHMA (#41770)

liuzijing2014 committed 1 day ago

Verified 09a7cc5b

[Core] Avoid using extra thread in `UniProcExecutor` (#40891)

njhill committed 1 day ago

Verified 10ebb40d

[Bugfix] Restore moe_forward output shape invariant on TRTLLM MXFP4 path (#41646)

stecasta committed 1 day ago

Verified 54f548e9

[Compressed Tensors] Allow configs with non-explicit ignores (#41965)

kylesayrs committed 1 day ago

Verified c1819ca2

Laguna xs dflash support (#41880)

MeganEFlynn committed 1 day ago

Verified 969fbfb4

[ROCm] Fix AITER AR+RMSNorm no-residual fusion (#41972)

akii96 committed 1 day ago

Verified 3af561ec

[ROCm][DeepSeek] Enable V3.2 TP4 AITER MLA (#41835)

akii96 committed 1 day ago

Verified c936548c

[Core] Replace routing replay with device cache and async D2H pipeline (#39917)

TomerBN-Nvidia committed 1 day ago

Verified 8189a159

[Refactor] Consolidate required/named tool_choice streaming into DelegatingParser (#41876)

sfeng33 committed 1 day ago

Verified 8eb40113

[Misc] Delay EPLB Nixl import until needed (#41805)

NickLucche committed 1 day ago

Verified 9d6500b8

Older