vllm-project/vllm

Pull Requests Commits

[PP] Correct cache size check (#13873)

zhengy001 committed 129 days ago

Verified 4b1d141f

[Misc] fixed 'required' is an invalid argument for positionals (#13948)

chaunceyjiang committed 129 days ago

Verified 10c3b8c1

[CI/Build] Add examples/ directory to be labelled by `mergify` (#13944)

b8zhong committed 129 days ago

Verified a7f37314

[V1][Metrics] Handle preemptions (#13169)

markmc committed 129 days ago

Verified cd711c48

[ROCm][V1] Update reshape_and_cache to properly work with CUDA graph padding (#13922)

SageMoore committed 129 days ago

Verified 378b3ef6

[misc] Rename Ray ADAG to Compiled Graph (#13928)

ruisearch42 committed 129 days ago

Verified c9944acb

Use CUDA 12.4 as default for release and nightly wheels (#12098)

mgoin committed 129 days ago

Verified ca377cf1

[ROCm][Quantization][Kernel] Use FP8 FNUZ when OCP flag is 0 or undefined (#13851)

HollowMan6 committed 129 days ago

Verified a31614e3

[Kernel] FlashMLA integration (#13747)

LucasWilkinson committed 129 days ago

Verified f9590390

[BugFix] Make FP8 Linear compatible with torch.compile (#13918)

WoosukKwon committed 129 days ago

Verified b382a7f2

[Bugfix] Backend option to disable xgrammar any_whitespace (#12744)

wallashss committed 129 days ago

Verified 4cb6fa0a

[Misc] fixed qwen_vl_utils parameter error (#13906)

chaunceyjiang committed 129 days ago

Verified d08b285a

[TPU] use torch2.6 with whl package (#13860)

Chenyaaang committed 130 days ago

Verified b27122ac

[Bugfix] Update expected token counts for Ultravox tests (#13895)

DarkLight1337 committed 130 days ago

Verified 934bb99c

[Bugfix] Do not crash V0 engine on input errors (#13101)

joerunde committed 130 days ago

Verified 3f808cc0

[Misc]: Add support for goodput on guided benchmarking + TPOT calculation refactor (#13736)

b8zhong committed 130 days ago

Verified ec8a5e53

[Bugfix] Handle None parameters in Mistral function calls. (#13786)

fgreinacher committed 130 days ago

Verified 215bf150

Add comments on accessing `kv_cache` and `attn_metadata` (#13887)

hmellor committed 130 days ago

Verified 0ecdd980

[Bugfix] Add test example for Ultravox v0.5 (#13890)

DarkLight1337 committed 130 days ago

Verified 7b700ec8

[Misc] Fix input processing for Ultravox (#13871)

ywang96 committed 130 days ago

Verified 7ca1da02

[Misc] Improve LoRA spelling (#13831)

jeejeelee committed 130 days ago

Verified 5157338e

[v0][Core] Use xgrammar shared context to avoid copy overhead for offline engine (#13837)

sethkimmel3 committed 130 days ago

Verified e206b543

[ROCm] Disable chunked prefill/prefix caching when running MLA on non-cuda platforms (#13844)

SageMoore committed 130 days ago

Verified 1d35662e

[Doc] fix the incorrect module path of tensorize_vllm_model (#13863)

tianyuzhou95 committed 130 days ago

Verified e656f638

Improve pipeline partitioning (#13839)

hmellor committed 130 days ago

Verified 145944cb

[Kernel][Build/CI] Bump CUTLASS to 3.8 and add initializers for cutlass epilogues (#13797)

henrylhtsang committed 130 days ago

Verified 094b7d94

[Misc]Code Cleanup (#13859)

noemotiovon committed 130 days ago

Verified e1fe7591

[V1][Spec Decode] Change Spec Decode Rejection Sampling API (#13729)

LiuXiaoxuanPKU committed 130 days ago

Verified 5629f26d

[misc] Show driver IP info when Ray fails to allocate driver worker (#13858)

ruisearch42 committed 130 days ago

Verified 9ba28043

DeepSeek V2/V3/R1 only place `lm_head` on last pp rank (#13833)

hmellor committed 130 days ago

Verified 24679788

Newer Older