vllm-project/vllm

Pull Requests Commits

port in vllm-bench

esmeetu committed 5 days ago

52e6004c

Remove TeleChatForCausalLM (#47989)

xianbaoqian committed 5 days ago

Verified ab7961a1

[Bugfix] Fix Qwen3-ASR transcription streaming postprocessing (#42478)

BWAAEEEK committed 5 days ago

Verified a07765c6

[CPU] Fix Qwen-Next SSM type for AMX GDN (#48073)

bigPYJ1151 committed 5 days ago

Verified 1171467e

[KV Offloading] Add free block iterator for CPU offload scheduling (#47849)

chaunceyjiang committed 5 days ago

Verified 529af888

[XPU][LoRA] Fix torch.compile DEVICE_LOST by avoiding view-mutation in LoRA shrink (#47944)

chaojun-zhang committed 5 days ago

Verified b8c7c865

[Bugfix][ROCm] Change AttentionCGSuppoort in TritonMLA to UNIFORM_SINGLE_TOKEN_DECODE (#47144)

music-dino committed 5 days ago

Verified 2c17d33f

[ROCm][CI][MoE] Fix double-transpose of fused w3 expert weights (#47874)

stefankoncarevic committed 5 days ago

Verified bc44f9fe

[KVConnector][NIXL] Support pipeline-parallel prefill in push mode (#45880)

zixi-qi committed 5 days ago

Verified 7802c20c

[Bugfix] Use int8 workspace for FlashInfer MLA decode (#48046)

njhill committed 5 days ago

Verified 95d6d6f4

Fix embed scaling + CUDA graphs in Transformers modelling backend (#48010)

hmellor committed 5 days ago

Verified 56da398d

[ROCm] Fix pooling startup workspace lock (#47912)

AndreasKaratzas committed 5 days ago

Verified 26831949

[docs] Fix the docs build (#48008)

hickeyma committed 5 days ago

Verified 6cf7b26b

[Feat] Add runtime monitor for post-warmup TileLang compilation (#46718)

LopezCastroRoberto committed 5 days ago

Verified 5f859756

[CI] GSM8K eval integration test for KV offloading (#46893)

tlrmchlsmth committed 5 days ago

Verified dcdd756d

Allow FlashInfer A2A backends for TRTLLM FP8 MoE Modular (#46661)

gau-nernst committed 5 days ago

Verified 0d2f4e7c

[ROCm][Bugfix] Fix empty-tensor .max() crash in AITER FA (#47894)

djramic committed 5 days ago

Verified 49abadae

[Perf] Integrate TRTLLM BF16 MoE Modular Kernel (#45182)

kjiang249 committed 5 days ago

Verified 089e4128

[Core] Move MRV1 `late_interaction_runner.py` out of MRV2 subtree (#48014)

njhill committed 5 days ago

Verified a5d19cbb

updated flash_attn GIT_TAG to point to torch Stable ABI FA3 commit (#47995)

cleonard530 committed 5 days ago

Verified 8347c6e6

[CI] BugFix Eval Small Models Distributed test for DiffusionGemma (#47980)

ilmarkov committed 5 days ago

Verified b2cf70ea

[Bugfix] Re-enable benchmarking of librispeech dataset. (#47033)

almayne committed 5 days ago

Verified d1f1d867

[Bugfix][DCP] Cast LSE to fp32 in a2a combine to fix bf16 bitcast crash (#47801)

shawntsai committed 5 days ago

Verified f05603fa

Fix FlashAttention MLA prefill V unpadding (#42642)

voipmonitor committed 5 days ago

Verified c2ecd0f8

[Spec Decode] Support hybrid (SWA + full attention) DFlash drafters (#47914)

mgoin committed 5 days ago

Verified 0d12618e

Fix NVML capability lookup for visible devices (#47892)

tlrmchlsmth committed 5 days ago

Verified 68b4a1d5

[Bug] Fix Batched DeepGEMM (#47884)

robertgshaw2-redhat committed 5 days ago

Verified 572b25b0

Improvement of Docker image build for IBM Power using prebuilt wheels from IBM published devpi index (#46017)

vivek8123 committed 5 days ago

Verified 9f2b3b09

[Bugfix][V1] Free out-of-window blocks on the processed-token basis under async scheduling (#47728)

Saddss committed 5 days ago

Verified cd0de48d

[CI/Build][BugFix][The Rock] Fix get_ssm_device_name to return sanitized, usable filename (#47781)

rasmith committed 5 days ago

Verified 934eeaec

Older