PR #38510 Fix blip2 tests

Fix blip2 tests #38510

ydshieh merged 17 commits into main from fix_blip2

fix 1: not sure

26d541bc

fix 2: _supports_flex_attn = False

35b0c80d

fix 3: embedding_output = self.layernorm(query_embeds.to(self.layerno…

c7f586ee

fix 4: query_embeds = query_embeds.to(self.layernorm.weight.dtype)

d9163f37

fix 5: text_embeds = text_embeds.to(dtype=torch.float16)

2cbf9013

fix 5: question_embeds.to(dtype=torch.float16)

58e8cbe7

fix 6: text_embeds = text_embeds.to(dtype=self.itm_head.weight.dtype)

d1c7db4e

fix 7: image_embeds and question_embeds

f2acf13a

fix 8: fix other 2 fp16 tests

6c97546e

fix 9: fix T5 OOM

fcd01209

fix 10: fix T5 OOM

7f90d9c2

fix 11: fix T5

5bf132c3

fix 11: fix T5 beam

c020fd4b

fix 12: _supports_sdpa=False

371fea18

fix 12: style and expect

75eebc06

ydshieh changed the title ~~Fix blip2~~ Fix blip2 tests 307 days ago

ydshieh commented on 2025-06-02

ydshieh requested a review from

zucchini-nlp 305 days ago

zucchini-nlp commented on 2025-06-02

revert

4c7b3000

revert

79d354ce

ydshieh requested a review from

zucchini-nlp 305 days ago

zucchini-nlp approved these changes on 2025-06-02

ydshieh merged de4cf5a3 into main 305 days ago

ydshieh deleted the fix_blip2 branch 305 days ago

Reviewers

zucchini-nlp

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Fix blip2 tests #38510 Merged

Fix blip2 tests #38510

transformers
Fix blip2 tests
#38510

Merged