vllm
[VLM] Support pan-and-scan for Gemma3 multi-modal processor
#14672
Merged

[VLM] Support pan-and-scan for Gemma3 multi-modal processor #14672

DarkLight1337
WoosukKwon Gemma3 1B working
046e05ae
WoosukKwon Add modeling_gemma3.py
669ae5a3
WoosukKwon remove
e044645d
WoosukKwon [TMP] Add HF Gemma 3
bd78da5a
WoosukKwon Fix config:
a50c2d59
WoosukKwon [TMP] image input
d2562cb9
WoosukKwon Update
017239ed
WoosukKwon Update
de0136aa
WoosukKwon update
12b7e9de
WoosukKwon minor
26b6199d
WoosukKwon Remove
b99336a1
WoosukKwon fix
004dc924
WoosukKwon Add kwargs
2bb965bc
WoosukKwon Hew HF
b1199455
WoosukKwon Fix scaling
4c675733
WoosukKwon bidirectional attn
d90d410c
WoosukKwon sliding window
366e4b5f
WoosukKwon Remove HF
77b9dd7b
WoosukKwon revert
f0f8e9d1
WoosukKwon add placeholder str
28e757b3
WoosukKwon Merge branch 'main' into woosuk-gemma3
a935b243
WoosukKwon minor
285ffc45
WoosukKwon Add comments
713766b0
WoosukKwon Minor
67460869
WoosukKwon cleanup
6fa03362
WoosukKwon tmp
0384ceb7
WoosukKwon minor
2beb1990
WoosukKwon Docs
64ef15f6
WoosukKwon ruff
d92c7c19
WoosukKwon Update transformers version
82acdcdd
WoosukKwon minor
29434439
WoosukKwon Minor
635e1a9d
WoosukKwon gg-hf-g -> google
02bf606b
WoosukKwon Merge branch 'main' into woosuk-gemma3
a4c924b0
WoosukKwon Fix example
7097fa88
WoosukKwon minor
ac72f69d
WoosukKwon minor
5ab60d01
WoosukKwon fix docs
3c42695f
WoosukKwon minor docs
883c656d
WoosukKwon polish
1d2a0643
WoosukKwon polish
0230237a
WoosukKwon fix reqs
32ebaf1b
WoosukKwon Remove hardcoded values
4b65deb7
WoosukKwon Fix
7ca73b1c
WoosukKwon Add min_transformers_version
d5f2eef4
WoosukKwon fix
a4dbd56d
WoosukKwon comment about pas
2a8e2fa7
DarkLight1337 Pass preprocessing check
f6490630
github-actions
mergify mergify added documentation
mergify mergify added frontend
mergify mergify added multi-modality
DarkLight1337 Update docs
5943f4f6
ywang96 fix input indices
49c1bb05
DarkLight1337 Add test
98fda46f
DarkLight1337 Fix prompt format
4dbf06c0
DarkLight1337 Use chat template
560d5be4
DarkLight1337 Update test prompts
0c554c67
ywang96 fix batch with mixed numbers of images
82f6fe1e
DarkLight1337 Simplify
cfeab906
DarkLight1337 Fix registry
3238bfd4
mergify
mergify mergify added needs-rebase
DarkLight1337 Merge branch 'main' into gemma3-crops
4af69e94
mergify mergify removed needs-rebase
DarkLight1337 DarkLight1337 marked this pull request as ready for review 281 days ago
DarkLight1337 DarkLight1337 requested a review from ywang96 ywang96 281 days ago
DarkLight1337 DarkLight1337 changed the title [VLM] Support `num_crops` for Gemma3 processor [VLM] Support `num_crops` for Gemma3 multi-modal processor 281 days ago
DarkLight1337 Merge branch 'main' into gemma3-crops
d8aad892
DarkLight1337 Fix the dtype
5efd112c
DarkLight1337 DarkLight1337 requested a review from WoosukKwon WoosukKwon 281 days ago
DarkLight1337 DarkLight1337 changed the title [VLM] Support `num_crops` for Gemma3 multi-modal processor [VLM] Support cropping for Gemma3 multi-modal processor 281 days ago
DarkLight1337 DarkLight1337 changed the title [VLM] Support cropping for Gemma3 multi-modal processor [VLM] Support pan-and-scan for Gemma3 multi-modal processor 281 days ago
DarkLight1337 Fix
164ff576
DarkLight1337 Fix
c32d51e3
DarkLight1337 Silence warnings
e7b9be95
DarkLight1337 Fix
acc0a066
DarkLight1337 Fix
4e33fd0d
DarkLight1337 DarkLight1337 added this to the v0.8.0 milestone 281 days ago
DarkLight1337 Update examples
144687b5
WoosukKwon
WoosukKwon commented on 2025-03-13
DarkLight1337 Fix example
7e0550e4
DarkLight1337 Apply pan and scan in tests
eeb19505
ywang96
ywang96 commented on 2025-03-13
DarkLight1337 Update docs and examples
9d210763
DarkLight1337 Avoid diffs
bc3a44f2
DarkLight1337 Simplify dummy data
645b186a
DarkLight1337 Fix
f30789a7
DarkLight1337 Add note
6bcd29b3
DarkLight1337 DarkLight1337 added ready
ywang96
ywang96 approved these changes on 2025-03-13
DarkLight1337 Address comments
926e4223
DarkLight1337
vllm-bot vllm-bot merged 38240392 into main 280 days ago
DarkLight1337 DarkLight1337 deleted the gemma3-crops branch 280 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone