PR #36981 Refactor attention for SigLIP based models

Refactor attention for SigLIP based models #36981

ydshieh merged 28 commits into huggingface:main from qubvel:refactor-attention-siglip-based

Update Siglip attention implementation

58aa6736

Update tests for Siglip

98b185d0

Remove one level of indentation

ab2d4d18

Update test to be more specific

b35be6d6

Fixup

72845f06

Idefics2

2486c942

Idefics3

23d233ba

Emu3

27fbf9af

SmolVLM

d153812f

Phi4 (just init small update)

0bbada48

Idefics2 (test fix)

0d4bf7f3

Update siglip2 tests

3859ebad

Update eager

1e7abf5a

qubvel added Vision

qubvel added Multimodal

qubvel marked this pull request as ready for review 346 days ago

github-actions requested a review from

ydshieh 346 days ago

github-actions requested a review from

zucchini-nlp 346 days ago

trigger

65531ad4

Clean up

209e00e0

Transfer inputs to device in test

81b2ae6f

qubvel removed review request from

ydshieh 346 days ago

qubvel removed review request from

zucchini-nlp 346 days ago

Fixing test

351b6851

Fixing test

8956fd6b

qubvel requested a review from

ydshieh 345 days ago

qubvel requested a review from

zucchini-nlp 345 days ago

zucchini-nlp commented on 2025-03-27

Revert contiguous

2b5579e2

Remove unused is_flash_attn_2_available

bb481f10

ydshieh commented on 2025-03-27