vllm-project/vllm

Pull Requests Commits

khluu committed 80 days ago

6042cc97

[AMD][Kernel][BugFix] Use correct scale in concat_and_cache_ds_mla_kernel when on gfx942 (#32976)

rasmith committed 81 days ago

Verified 58996f35

[Models] Kimi-K2.5 (#33131)

ywang96 committed 81 days ago

Verified b539f988

[CI][Pooling] Stabilize ModernBERT test (#32909)

AndreasKaratzas committed 81 days ago

Verified 6c006457

[code clean] remove duplicate code (#33135)

andyxning committed 81 days ago

Verified b781eeaa

[Frontend] Cleanup serving engine (#33103)

DarkLight1337 committed 81 days ago

Verified e0b005d9

[torch.compile] Stop assuming 32 bit indexing (#33113)

zou3519 committed 81 days ago

Verified 3b8f0fe5

[Frontend] Reduce mixin usage in serving pooling (#33101)

DarkLight1337 committed 81 days ago

Verified c831911b

[Perf] avoid duplicate mem_get_info() call in get_current_memory_usage (#33064)

pacoxu committed 81 days ago

Verified 157caf51

[DOC]: Add warning about max_num_batched_tokens and max_model_len when chunked prefill is disabled (#33109)

VincentG1234 committed 81 days ago

Verified 0b53bec6

Fix IndexError with encoder-decoder models when using Custom Paged Attention (#33112)

sstamenk committed 81 days ago

Verified c568581f

fix: preserve native tool call ID in multi-turn tool calling (#32768)

wangln19 committed 81 days ago

Verified 2d705343

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567)

robertgshaw2-redhat committed 81 days ago

Verified 5a93b916

[Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055)

WoosukKwon committed 81 days ago

Verified 6d86fde0

[Bugfix][TPU] Return a Default fp8 MoE Backend (#32908)

vanbasten23 committed 81 days ago

Verified 510ed1e8

[Bugfix][MXFP4] Call `trtllm_fp4_block_scale_moe` with kwargs (#33104)

wpc committed 81 days ago

Verified 8caffd92

[fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913)

dolpm committed 81 days ago

Verified 58a05b0c

[Logging] add `--disable-access-log-for-endpoints` CLI option (#30011)

JaredforReal committed 81 days ago

Verified 6ee7f18f

[Refactor] Remove unused `_moe_permute` function (#33108)

yewentao256 committed 81 days ago

Verified 8f987883

[ci] Sync test areas with test-pipeline.yaml and enable new pipeline generator (#33080)

khluu committed 81 days ago

Verified ebe0ba91

[Bugfix] Fix Dtypes for Pynccl Wrapper (#33030)

robertgshaw2-redhat committed 81 days ago

Verified 43a013c3

[Model] Bump transformers version for test registry (#33100)

DarkLight1337 committed 82 days ago

Verified c25dbee4

[Bugfix] Fix Voxtral streaming slot_mapping (#33073)

NickLucche committed 82 days ago

Verified 19ab0f7c

[FIX] Always support TP > 4 for FP4 Gemm (#31099)

danielafrimi committed 82 days ago

Verified 67fe677c

Remove unused logic in `models/mistral.py` (#33095)

andylolu2 committed 82 days ago

Verified d56afd45

[CI] Fix AssertionError: MCP tool call not found in output_messages (#33093)

chaunceyjiang committed 82 days ago

Verified a2393ed4

[ROCm][Bugfix] Fix ptpc scale load issue for fused shared expert path in deepseek mtp (#33018)

ganyi1996ppo committed 82 days ago

Verified be6931ee

[Bugfix] Fix Can't instantiate abstract class DeepseekV32IndexerBackend (#33052)

chaunceyjiang committed 82 days ago

Verified 9ef3b718

[GLM-OCR] GLM-OCR with MTP Support (#33005)

zRzRzRzRzRzRzR committed 82 days ago

Verified bb17e8f1

[Chore] Update type annotation of `input_ids` in model forward (#33063)

DarkLight1337 committed 82 days ago

Verified dcd80206

Older