vllm-project/vllm

Pull Requests Commits

Add time comment

tlrmchlsmth committed 1 year ago

031c8b32

Merge branch 'main' into mamba_tests

tlrmchlsmth committed 1 year ago

ac08d452

Add patch merger (#14957)

patrickvonplaten committed 1 year ago

Verified d20b0c13

[Doc] Fix misleading log during multi-modal profiling (#14955)

DarkLight1337 committed 1 year ago

Verified 166a168b

[Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810)

vllmellm committed 1 year ago

Verified 2bb0e1a7

[Misc] Add `--seed` option to offline multi-modal examples (#14934)

DarkLight1337 committed 1 year ago

Verified 6eaf1e5c

[Bugfix] Fix Ultravox on V1 (#14929)

DarkLight1337 committed 1 year ago

Verified 868a8c5b

[V1][TPU] Apply the ragged paged attention kernel fix and remove the padding. (#14846)

vanbasten23 committed 1 year ago

Verified b4ad56c1

fix minor miscalled method (#14327)

kushanam committed 1 year ago

Verified 69698f25

[MISC] More AMD unused var clean up (#14926)

houseroad committed 1 year ago

Verified cd0cd851

setup.py: drop assumption about local `main` branch (#14692)

russellb committed 1 year ago

Verified 0a74bfce

[Doc] Add vLLM Beijing meetup slide (#14938)

heheda12345 committed 1 year ago

Verified dd3b8658

[Misc][XPU] Use None as device capacity for XPU (#14932)

yma11 committed 1 year ago

Verified 9b87a579

[V1] Remove input cache client (#14864)

DarkLight1337 committed 1 year ago

Verified b539222d

[V1] [Spec Decode] Support random sampling for spec decode (#13933)

LiuXiaoxuanPKU committed 1 year ago

Verified 8d6cf895

[Benchmark] Do not save detailed info to json by default (#14879)

simon-mo committed 1 year ago

Verified 583a9778

[Misc] Replace os environ to monkeypatch in test suite (#14516)

t-sibiraj committed 1 year ago

Verified a73e183e

[BugFix] Fix MLA + V1 + TP==1 causing reinitialization of cuda context (#14910)

LucasWilkinson committed 1 year ago

Verified 1e799b7e

[V1][Minor] Add __repr__ to ConstantList (#14907)

WoosukKwon committed 1 year ago

Verified 7f6c5ee0

[V1] Optimize the overhead of rewinding (#14905)

WoosukKwon committed 1 year ago

Verified faa02757

[CI/Build] Update defaults for test reproducibility (#14893)

DarkLight1337 committed 1 year ago

Verified 8a5a9b70

[CI] Nightly Tests (#14898)

robertgshaw2-redhat committed 1 year ago

Verified bb3aeddf

[V1] Enable Entrypoints Tests (#14903)

robertgshaw2-redhat committed 1 year ago

Verified aecc780d

[Doc] Add guidance for using `ccache` with `pip install -e .` in doc (#14901)

vadiklyutiy committed 1 year ago

Verified 90df7f23

[Misc] Catching Ray Compiled Graph PP test failures for V1 (#14847)

ruisearch42 committed 1 year ago

Verified b9b5bdfc

[V1][BugFix] Detect interleaved sliding window attention (#14896)

WoosukKwon committed 1 year ago

Verified 31060b27

[BugFix][V1] Fix overhead related to bad_words sampling when not in use (#14894)

njhill committed 1 year ago

Verified fc1f6771

Revert "[Bugfix] Limit profiling run sequence length by max_model_len (#14785) (#14892)

DarkLight1337 committed 1 year ago

Verified f6137adb

[Bugfix] Explicitly disable Phi-4-multimodal in V1 (#14889)

DarkLight1337 committed 1 year ago

Verified e53b1350

[Bugfix] Limit profiling run sequence length by max_model_len (#14785)

kylesayrs committed 1 year ago

Verified d30aa7e9

Older