PR #30348 Llama: fix custom 4D masks, v2

Llama: fix custom 4D masks, v2 #30348

ArthurZucker merged 16 commits into huggingface:main from poedator:4d_fix_2

poedator changed the title ~~4d fix 2~~ Llama: fix custom 4D masks, v2 2 years ago

poedator force pushed 2 years ago

poedator marked this pull request as ready for review 2 years ago

ArthurZucker commented on 2024-04-22

poedator force pushed 2 years ago

gante approved these changes on 2024-04-23

ArthurZucker commented on 2024-04-26

poedator force pushed 2 years ago

4d mask fixes

4da1061a

Update custom 4D mask logic

be0f9267

test moved to mixin

a4c7ba9b

extra tests 4d mask

72c4bef2

upd 4d mask and StaticCache handling

48f5af92

added Mask4DTestHard to mistral tests

71753fc7

post-rebase fixes

406f6e6c

test fixes for StaticCache

2592fb07

make fix-copies

bf9a21ec

poedator force pushed to bf9a21ec 2 years ago

upd 1 after #30476

99786292

ArthurZucker commented on 2024-05-07

fix common tests

2eaa5fff

rm elif attention_mask.dim() == 4:

2e59ed4a

tests combined, fixed, mixtral supported

6677995b

ArthurZucker approved these changes on 2024-05-10

bigbird style chg reverted

46726163

rm if attention_mask.dim() == 2

bb063309

modeling_llama formatting chg

a4a189f5

ArthurZucker approved these changes on 2024-05-13

ArthurZucker merged a0779b9e into main 2 years ago

poedator deleted the 4d_fix_2 branch 1 year ago

Reviewers

ArthurZucker

gante

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Llama: fix custom 4D masks, v2 #30348 Merged

Llama: fix custom 4D masks, v2 #30348

transformers
Llama: fix custom 4D masks, v2
#30348

Merged