vllm-project/vllm

Pull Requests Commits
[Bugfix] torchrun compatibility (#14899)
hiyouga committed 93 days ago
Verified 41491913
[Misc] Embedding model support LoRA (#14935)
jeejeelee committed 93 days ago
Verified db7c8ca9
[Mistral-Small 3.1] Update docs and tests (#14977)
patrickvonplaten committed 93 days ago
Verified f863ffc9
[Kernels] LoRA - Retire SGMV and BGMV Kernels (#14685)
varun-sundar-rabindranath committed 93 days ago
Verified 400d483e
[Doc][V1] Fix V1 APC doc (#14920)
shen-shanshan committed 93 days ago
Verified d1695758
[Neuron] trim attention kernel tests to fit trn1.2x instance (#14988)
liangfu committed 93 days ago
Verified 53a0cf8b
[Bugfix] Fix bnb quantization for models with both HF-format and Mistral-format weights (#14950)
tristanleclercq committed 93 days ago
Verified 5eeabc2a
[V1] TPU - Fix CI/CD runner (#14974)
alexm-redhat committed 93 days ago
Verified 18551e82
[V1] Guard Against Main Thread Usage (#14972)
robertgshaw2-redhat committed 94 days ago
Verified e41e1602
[CI/Build] Use `AutoModelForImageTextToText` to load VLMs in tests (#14945)
DarkLight1337 committed 94 days ago
Verified b89fb2a4
[Bugfix] Fix interface for Olmo2 on V1 (#14976)
ywang96 committed 94 days ago
Verified 5340b0e2
[Bugfix] Make Gemma3 MM V0 only for now (#14971)
ywang96 committed 94 days ago
Verified 37e38061
[Fix][Structured Output] using vocab_size to construct matcher (#14868)
aarnphm committed 94 days ago
Verified c0efdd65
[Bugfix][Model] Mixtral: use unused head_dim config argument (#14961)
qtrrb committed 94 days ago
Verified aaaec52a
[Bugfix] Fix precommit - line too long in pixtral.py (#14960)
tlrmchlsmth committed 94 days ago
Verified e1eb45d3
[V1] Default MLA to V1 (#14921)
simon-mo committed 94 days ago
Verified 89fca671
Add patch merger (#14957)
patrickvonplaten committed 94 days ago
Verified d20b0c13
[Doc] Fix misleading log during multi-modal profiling (#14955)
DarkLight1337 committed 94 days ago
Verified 166a168b
[Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810)
vllmellm committed 94 days ago
Verified 2bb0e1a7
[Misc] Add `--seed` option to offline multi-modal examples (#14934)
DarkLight1337 committed 94 days ago
Verified 6eaf1e5c
[Bugfix] Fix Ultravox on V1 (#14929)
DarkLight1337 committed 94 days ago
Verified 868a8c5b
[V1][TPU] Apply the ragged paged attention kernel fix and remove the padding. (#14846)
vanbasten23 committed 94 days ago
Verified b4ad56c1
fix minor miscalled method (#14327)
kushanam committed 94 days ago
Verified 69698f25
[MISC] More AMD unused var clean up (#14926)
houseroad committed 94 days ago
Verified cd0cd851
setup.py: drop assumption about local `main` branch (#14692)
russellb committed 94 days ago
Verified 0a74bfce
[Doc] Add vLLM Beijing meetup slide (#14938)
heheda12345 committed 94 days ago
Verified dd3b8658
[Misc][XPU] Use None as device capacity for XPU (#14932)
yma11 committed 94 days ago
Verified 9b87a579
[V1] Remove input cache client (#14864)
DarkLight1337 committed 94 days ago
Verified b539222d
[V1] [Spec Decode] Support random sampling for spec decode (#13933)
LiuXiaoxuanPKU committed 94 days ago
Verified 8d6cf895
[Benchmark] Do not save detailed info to json by default (#14879)
simon-mo committed 94 days ago
Verified 583a9778
Terms Of Use Privacy Policy Refund Policy Impressum