vllm
Feature/benchmark/random mm data/images
#23119
Merged
Overview
Commits
30
Changes
View On GitHub

Feature/benchmark/random mm data/images #23119

ywang96 merged 30 commits into vllm-project:main from h-brenoskuk:Feature/Benchmark/RandomMMData/Images
h-brenoskuk
github-actions
mergify mergify added performance
gemini-code-assist
gemini-code-assist commented on 2025-08-18
h-brenoskuk refactor RandomDataset
9c121e89
h-brenoskuk add RandomMultiModalData class
94acdc63
h-brenoskuk add note on enable-multimodal-chat
66eac492
h-brenoskuk Add mm max num images arg to prevent error
5b8e9411
h-brenoskuk raise error if min_num_images > max_num_images
1323d9d1
h-brenoskuk h-brenoskuk force pushed to 1323d9d1 347 days ago
h-brenoskuk Delete duplicated code from rebase
e5d23f96
h-brenoskuk add random-mm to vllm/benchmarks/README.md
377e7e37
h-brenoskuk add docstring to RandomData
a233dd53
DarkLight1337 DarkLight1337 requested a review from mgoin mgoin 347 days ago
DarkLight1337 DarkLight1337 requested a review from ywang96 ywang96 347 days ago
DarkLight1337
DarkLight1337 commented on 2025-08-19
h-brenoskuk address review comment and add request_id_prefix following PR #20638
dace479d
DarkLight1337
DarkLight1337 commented on 2025-08-19
DarkLight1337
DarkLight1337 commented on 2025-08-19
h-brenoskuk Improve the error message for easier debugging and clean code
6376540c
h-brenoskuk simple RandomDataset test
5edd4b69
h-brenoskuk h-brenoskuk force pushed to 5edd4b69 347 days ago
h-brenoskuk add edge case to random dataset test to check for rng isolation
0bc5a27a
h-brenoskuk rename _np_rng to _rng and add disclaimer. improve distortion in tests
adfd529f
h-brenoskuk h-brenoskuk force pushed to adfd529f 347 days ago
h-brenoskuk correct test_random_dataset_different_seeds where seeds would exchang…
501f5160
DarkLight1337
DarkLight1337 commented on 2025-08-19
h-brenoskuk
DarkLight1337
DarkLight1337
DarkLight1337 approved these changes on 2025-08-19
h-brenoskuk Merge remote-tracking branch 'upstream/main' into Feature/Benchmark/R…
646dd217
h-brenoskuk
DarkLight1337 DarkLight1337 added ready
DarkLight1337
DarkLight1337
h-brenoskuk
h-brenoskuk add kwargs to sample method of RandomDataset and RandomMultiModalDataset
a2d884d8
SamitHuang
SamitHuang commented on 2025-08-21
h-brenoskuk Merge remote-tracking branch 'upstream/main' into Feature/Benchmark/R…
90af88a1
h-brenoskuk add video capability to RandomMultiModalDataset (wip)
136b535e
h-brenoskuk naive sampling for multimodal items
cddf67dc
h-brenoskuk improve sampling to always return desired nb of mm items
e2ca6bcc
h-brenoskuk add cli parsing for bucket config and correct width/height in synth m…
ffa5f4e4
h-brenoskuk h-brenoskuk requested a review from SamitHuang SamitHuang 345 days ago
h-brenoskuk
h-brenoskuk add tests on random-mm dataset generation
0fa6614e
h-brenoskuk Update Readme
c37853f2
h-brenoskuk Fix mypy-3.9 issue in test
5da586fe
h-brenoskuk h-brenoskuk requested a review from DarkLight1337 DarkLight1337 345 days ago
DarkLight1337
DarkLight1337 commented on 2025-08-22
h-brenoskuk Merge remote-tracking branch 'upstream/main' into Feature/Benchmark/R…
eafc7857
h-brenoskuk Improve docstring and Readme. Rename num_mm_items_per_request to base…
2bbdb99a
h-brenoskuk test to verify bucket isn't mutated
e7ad83a6
ywang96
ywang96 requested changes on 2025-08-23
h-brenoskuk Place random-mm readme inside Multi-Modal Benchmark
7c447325
h-brenoskuk Remove blank line
9f68949f
h-brenoskuk Merge remote-tracking branch 'upstream/main' into Feature/Benchmark/R…
8946cb7d
h-brenoskuk h-brenoskuk requested a review from ywang96 ywang96 341 days ago
ywang96
ywang96 approved these changes on 2025-08-25
ywang96 ywang96 merged 0cb7b065 into main 341 days ago
shawn9977

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
performance ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum