vllm
[VLM] Support pan-and-scan for Gemma3 multi-modal processor
#14672

Merged

[VLM] Support pan-and-scan for Gemma3 multi-modal processor #14672

vllm-bot merged 74 commits into vllm-project:main from DarkLight1337:gemma3-crops

Gemma3 1B working

046e05ae

Add modeling_gemma3.py

669ae5a3

remove

e044645d

[TMP] Add HF Gemma 3

bd78da5a

Fix config:

a50c2d59

[TMP] image input

d2562cb9

Update

017239ed

Update

de0136aa

update

12b7e9de

minor

26b6199d

Remove

b99336a1

fix

004dc924

Add kwargs

2bb965bc

Hew HF

b1199455

Fix scaling

4c675733

bidirectional attn

d90d410c

sliding window

366e4b5f

Remove HF

77b9dd7b

revert

f0f8e9d1

add placeholder str

28e757b3

Merge branch 'main' into woosuk-gemma3

a935b243

minor

285ffc45

Add comments

713766b0

Minor

67460869

cleanup

6fa03362

tmp

0384ceb7

minor

2beb1990

Docs

64ef15f6

ruff

d92c7c19

Update transformers version

82acdcdd

minor

29434439

Minor

635e1a9d

gg-hf-g -> google

02bf606b

Merge branch 'main' into woosuk-gemma3

a4c924b0

Fix example

7097fa88

minor

ac72f69d

minor

5ab60d01

fix docs

3c42695f

minor docs

883c656d

polish

1d2a0643

polish

0230237a

fix reqs

32ebaf1b

Remove hardcoded values

4b65deb7

Fix

7ca73b1c

Add min_transformers_version

d5f2eef4

fix

a4dbd56d

comment about pas

2a8e2fa7

Pass preprocessing check

f6490630

mergify added documentation

mergify added frontend

mergify added multi-modality

Update docs

5943f4f6

fix input indices

49c1bb05

Add test

98fda46f

Fix prompt format

4dbf06c0

Use chat template

560d5be4

Update test prompts

0c554c67

fix batch with mixed numbers of images

82f6fe1e

Simplify

cfeab906

Fix registry

3238bfd4

mergify added needs-rebase

Merge branch 'main' into gemma3-crops

4af69e94

mergify removed needs-rebase

DarkLight1337 marked this pull request as ready for review 281 days ago

DarkLight1337 requested a review from

ywang96 281 days ago

DarkLight1337 changed the title ~~[VLM] Support `num_crops` for Gemma3 processor~~ [VLM] Support `num_crops` for Gemma3 multi-modal processor 281 days ago

Merge branch 'main' into gemma3-crops

d8aad892

Fix the dtype

5efd112c

DarkLight1337 requested a review from

WoosukKwon 281 days ago

DarkLight1337 changed the title ~~[VLM] Support `num_crops` for Gemma3 multi-modal processor~~ [VLM] Support cropping for Gemma3 multi-modal processor 281 days ago

DarkLight1337 changed the title ~~[VLM] Support cropping for Gemma3 multi-modal processor~~ [VLM] Support pan-and-scan for Gemma3 multi-modal processor 281 days ago

Fix

164ff576

Fix

c32d51e3

Silence warnings

e7b9be95

Fix

acc0a066

Fix

4e33fd0d

DarkLight1337 added this to the v0.8.0 milestone 281 days ago

Update examples

144687b5

WoosukKwon commented on 2025-03-13

Fix example

7e0550e4

Apply pan and scan in tests

eeb19505

ywang96 commented on 2025-03-13

Update docs and examples

9d210763

Avoid diffs

bc3a44f2

Simplify dummy data

645b186a

Fix

f30789a7

Add note

6bcd29b3

DarkLight1337 added ready

ywang96 approved these changes on 2025-03-13

Address comments

926e4223

vllm-bot merged 38240392 into main 280 days ago

DarkLight1337 deleted the gemma3-crops branch 280 days ago

Reviewers

ywang96

WoosukKwon

Assignees

No one assigned

Labels

documentation frontend ready multi-modality

Milestone

v0.8.0

vllm [VLM] Support pan-and-scan for Gemma3 multi-modal processor #14672 Merged

[VLM] Support pan-and-scan for Gemma3 multi-modal processor #14672

vllm
[VLM] Support pan-and-scan for Gemma3 multi-modal processor
#14672

Merged