Attn implementation for composite models #32238
zucchini-nlp
merged
74 commits into
huggingface:main
from
zucchini-nlp:vlm_sdpa_flag
first try
028e5026
codestyle
589d18af
idefics2 is happy
b33982ff
[run-slow] llava, llava_next, video_llava, vipllava, llava_next_video…
b0baa75e
fix-copies
9f192113
[run-slow] llava, llava_next, video_llava, vipllava, llava_next_video…
19e0f3fc
blip-2 needs to init vision from config
56a6f819
when was this removed O_o
bbff1ac0
minor fix
8485df9a
tests
ba7ee7f6
qubvel
commented
on 2024-07-26
ydshieh
commented
on 2024-07-26
this way?
d793d04b
tests
58aff275
model-agnostic code
4e4bd274
codestyle
52e77b34
add tests for idefics
0feec1e4
modify general test for VLMs
7b610963
no generation test for vlm yet!
9d15024f
no generation test here also
4e20af65
wanr in VIT-SDPA if output attn
1c6435d6
add more tests
ea71d89f
user can pass dict as attn impl
17f9e69f
repo consistency
140f2228
update
36485378
muicgen
ca95feef
no prints
79cae6d5
forgot speech enc-dec and clip
378274b0
how many composite models we have?
a772ff51
musicgen meelody is same as mudicgen
3e6787c7
+siglip
00b20656
fix tests + add some more
5cdfbfb1
remove idefics custom overriden code
723f27db
make idefics2 automappable
198c60c6
nits
27136160
skip tests
3aef7632
doctests
6c319349
Update src/transformers/models/idefics2/configuration_idefics2.py
2f901762
Update tests/models/clip/test_modeling_clip.py
3dfb48ce
Update tests/models/idefics2/test_modeling_idefics2.py
505ed3fd
Update tests/models/idefics2/test_modeling_idefics2.py
4c9f8945
Update src/transformers/configuration_utils.py
d7d54f8e
major update, no need for automap
b6e9951e
clean up
d1a291c0
add FA2 test
57119b11
more tests
cfb91984
merge main
720694fa
style
a2e90627
skip tests
e72c03df
why did these started failing now?
60df8720
no attributes for FA2 needed
6d128971
one tiny test
957e64eb
zucchini-nlp
changed the title 
address comment about FA2 false warning
94e7578a
merge main
2607d946
style
59aa4804
add new models and resolve conflicts
1dc8bd18
fix copies
04aba9fd
let it be this way for now, come back tomorrow to review
598b6f5a
some more fixes
6d02e5c0
zucchini-nlp
commented
on 2024-10-04
update
a578fdc9
more updates
c02a9439
update
19de5950
fix copies
d691097d
Merge remote-tracking branch 'upstream/main' into vlm_sdpa_flag
1fa548fe
style and tests
39c032e3
zucchini-nlp
commented
on 2024-10-04
another big update
74b211f8
fix tests
6dcf21a0
Merge remote-tracking branch 'upstream/main' into vlm_sdpa_flag
5a6ffe7f
fix tests
b93b79a7
update
702dacf8
another update
0616732c
Merge branch 'main' into vlm_sdpa_flag
28859cef
fix tests
ebf15efc
ArthurZucker
approved these changes
on 2024-10-15
merge main
0941fee7
fix copies
24a9fc53
fix tests
4eed237d
Reviewers
Assignees
No one assigned
Labels
run-slow
Milestone
No milestone
Login to write a write a comment.
Login via GitHub