Commits vllm-project/vllm

[Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630)

DarkLight1337 committed 177 days ago

Verified 32dffc27

[Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166)

minosfuture committed 177 days ago

Verified c438183e

[CI] Increase the threshold of the MTEB RERANK tests (#20615)

noooop committed 177 days ago

Verified baba0389

Revert invalid spellchecker fix on deepseek_vl2 (#20618)

viravera committed 177 days ago

Verified c6c22f16

[Model] Implement missing `get_language_model` for Keye-VL (#20631)

DarkLight1337 committed 177 days ago

Verified dd382e0f

Update torch/xla pin to 20250703 (#20589)

vanbasten23 committed 177 days ago

Verified 849590a2

[xpu]feat: support multi-lora on xpu (#20616)

yma11 committed 177 days ago

Verified a4c23314

Stop using title frontmatter and fix doc that can only be reached by search (#20623)

hmellor committed 177 days ago

Verified b942c094

Remove unnecessary explicit title anchors and use relative links instead (#20620)

hmellor committed 177 days ago

Verified b4bab816

[Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601)

crypdick committed 177 days ago

Verified b91cb3fa

[PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139)

NickLucche committed 178 days ago

Verified 71d1d75b

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)

sangstar committed 178 days ago

Verified 72d14d0e

[TPU] Temporary fix vmem oom for long model len by reducing page size (#20278)

Chenyaaang committed 178 days ago

Verified e34d130c

[CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560)

bigPYJ1151 committed 178 days ago

Verified 7721ef17

[Misc] improve error msg (#20604)

reidliu41 committed 178 days ago

Verified 8369b7c2

[Docs] Add Anyscale to frameworks (#20590)

crypdick committed 178 days ago

Verified 3eb4ad53

[Docs] Add Ray Serve LLM section to openai compatible server guide (#20595)

crypdick committed 178 days ago

Verified 90a2769f

[Docs] Improve docstring for ray data llm example (#20597)

crypdick committed 178 days ago

Verified e60d422f

[Docs] Rewrite offline inference guide (#20594)

crypdick committed 178 days ago

Verified 0d914c81

[Doc] Syntax highlight request responses as JSON instead of bash (#20582)

hmellor committed 178 days ago

Verified 6e428cdd

[Bugfix]: Fix messy code when using logprobs (#19209)

chaunceyjiang committed 178 days ago

Verified 93b9d9f4

Make distinct `code` and `console` admonitions so readers are less likely to miss them (#20585)

hmellor committed 178 days ago

Verified af107d5a

[Optimize] Don't send token ids when kv connector is not used (#20586)

WoosukKwon committed 178 days ago

Verified 31c5d0a1

[Bugfix] Fix Maverick correctness by filling zero to cache space in cutlass_moe (#20167)

minosfuture committed 178 days ago

Verified afb7cff1

[Misc] Improve logging for dynamic shape cache compilation (#20573)

kyolebu committed 178 days ago

Verified d2e841a1

[Config] Refactor mistral configs (#20570)

patrickvonplaten committed 178 days ago

Verified 14601f5f

Fix links in multi-modal model contributing page (#18615)

hmellor committed 178 days ago

Verified 042d131f

[Misc] feat output content in stream response (#19608)

lengrongfu committed 178 days ago

Verified 8e807cdf

[Misc] Add fully interleaved support for multimodal 'string' content format (#14047)

Dekakhrone committed 178 days ago

Verified e601efcb

[Kernel] Optimize Prefill Attention in Unified Triton Attention Kernel (#20308)

jvlunteren committed 178 days ago

Verified 22dd9c27