vllm-project/vllm

Pull Requests Commits

Robert Shaw committed 66 days ago

64f77e5f

poc of removing ModularKernelMethod and maybe_init_modular_kernel

Robert Shaw committed 66 days ago

fe60cc07

Merge remote-tracking branch 'origin/main' into clean-up-fp8-process-after-loading

Robert Shaw committed 67 days ago

7822c4d2

[BugFix] Fix cache issue in compilation_config (#31376)

BoyuanFeng committed 67 days ago

Verified 2f12cd32

[Chore]: Remove HF format Phi4-MM examples (#31405)

Isotr0py committed 67 days ago

Verified 40a87562

[CI/Build] Ignore max transformers version for more common tests (#31401)

Isotr0py committed 67 days ago

Verified 3d024985

Fix/get raw stream patch #30905 (#30912)

baonudesifeizhai committed 67 days ago

Verified 8711b216

[Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166)

ivanium committed 67 days ago

Verified 52bf0665

[XPU][CI]skip test_preprocess_error_handling due to fork/spawn issue (#31381)

jikunshang committed 67 days ago

Verified 5326c898

CustomOp: Unify aiter impl into GroupedTopk (#31221)

xinyu-intel committed 67 days ago

Verified 87f1b8ca

[Docs] Add profiler user docs for http request (#31370)

lengrongfu committed 68 days ago

Verified 887e900b

[Mistral common] Ensure all functions are imported from the top & only use public methods (#31138)

patrickvonplaten committed 68 days ago

Verified 48e74497

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674)

jeejeelee committed 68 days ago

Verified ce1eafd1

[Docs] Fix some snippets (#31378)

hmellor committed 68 days ago

Verified 0b544e64

[Misc] Fix Qwen2-MoE shared_expert_gate (#31339)

jeejeelee committed 68 days ago

Verified c3666f56

[CI] Fix flaky vision beam search test with flexible semantic validation (#31324)

AndreasKaratzas committed 68 days ago

Verified c79dbfa9

Support LoRA and GPTQModel for PLaMo 2/3 (#31322)

Alnusjaponica committed 68 days ago

Verified 9ee05cbe

[benchmark] use model card root instead of id (#31329)

andyxning committed 68 days ago

Verified 3b8f31b3

[CI/Build] Ignore max transformers version skipping for initialization tests (#30619)

Isotr0py committed 68 days ago

Verified 2cd94259

Feature/isaac 0.1 (#28367)

oscardev256 committed 68 days ago

Verified b7165d53

[BugFix] Fix async scheduling + reasoning with struct output (#31332)

njhill committed 68 days ago

Verified 81786c87

[Hybrid] Mamba2 prefix cache blocks freeing for running requests (#28047)

s3woz committed 68 days ago

Verified f1531d9f

[Model][Ernie4.5-VL] Support video metadata for timestamp rendering (#31274)

Tiiiktak committed 69 days ago

Verified 2d6001f4

use the same stream for cuda graph catpure and replay for NCCL (#29207)

Amir-19 committed 69 days ago

Verified 030fc449

[Doc] Add troubleshooting for Triton PTX error about undefined gpu-name (#31338)

Isotr0py committed 69 days ago

Verified 2532f437

[Benchmark Suite] improve cpu Benchmark Suite tests and comparison report for 0.12.0 (#30994)

louie-tsai committed 69 days ago

Verified f15185fb

[Frontend] add FunctionGemma tool parser support (#31218)

gateremark committed 69 days ago

Verified ba25a659

[Doc] Add tool call parser documentation for GPT-OSS models (#31212)

amithkk committed 69 days ago

Verified 42826bbc

[Bugfix] Fix eagle dp tests on A100 (#31241)

zou3519 committed 69 days ago

Verified 254f6b98

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

mgoin committed 69 days ago

Verified bc5ef333

Older