:rotating_light: Vision (2d/3d) rotary embeddings #48105
zucchini-nlp
merged
87 commits into
huggingface:main
from
zucchini-nlp:rope-vision
delete
0dc76b5d
fix repo
5c458d8d
.
1595f38d
add video processor docs
b50faeef
seems like this is expected
aa9d08f3
main
6a8b9e34
style
1e8b724c
fix repo
d15a604b
i dont understand
b32da06d
ah this was not needed
0eb1271a
add docstring back where needed
53aee252
self reveiw
469e7061
modular has no way to stop copying docstring...
dde1726c
comments
961409ad
unpack kwargs
79895ac6
fix tests
e1ae9ace
Merge remote-tracking branch 'upstream/main' into rope-vision
2d41492a
oke, at least these are same, let's keep digging
4223cdb6
.
68e8beec
second .
c2269094
and like this
6b6de13f
draft
9af201e3
Merge remote-tracking branch 'upstream/main' into rope-vision
34908506
maybe
b79c7445
commit before i break it
ae5c85ae
i think this is the last one from varity of ropes, now to update all …
5aade781
vision-only rope qwen
f6c9dfc3
run fix-repo
b3093fab
this will take soo long to fix every model
b092d0c6
sooooo long
dd108f9d
!
3b2ee8dd
one by one, hopefully i fix it all by eow
d2a429a1
fix the rest
49ecee23
and left-out sam
cb78272c
fix repo most
b3aec8a2
and now fix repo for special omni models
6fcec683
a bit more of fix repo
9c06f267
Merge remote-tracking branch 'upstream/main' into rope-vision
9df680a1
new model was merged, ci wont run
3ade9fef
suppress TRF, it comes from `main`
2e6ac10e
IlyasMoutawwakil
commented
on 2026-08-20
IlyasMoutawwakil
commented
on 2026-08-20
wording
c3ebe7f3
.
f3902896
gemma4, standardize 2D position IDs tmrw
7fce63d3
fix repo
e7866b1f
testers were working on pure luck, love it
033b1a82
fix repo
173f1d60
failing tests
79cd48ab
a bit more
a436522b
i suppose revert, why i changed it
f3356951
fix style
8740a89e
lost type annotations
c99f3d60
zucchini-nlp
commented
on 2026-08-25
zucchini-nlp
commented
on 2026-08-25
zucchini-nlp
commented
on 2026-08-25
zucchini-nlp
commented
on 2026-08-25
Merge remote-tracking branch 'upstream/main' into rope-vision
e38a68c1
fix Sam copied incorrectly
e8927ab9
qwen3 vl fix
fdada460
move sam positions to buffer
b80d7111
modular convert
893d97c4
Merge branch 'main' into rope-vision
4023a102
what? why CI never complained?!
2747e900
zucchini-nlp
changed the title
Merge remote-tracking branch 'upstream/main' into rope-vision
fccbd753
forgot this
83c152de
add the decorators where missing
38c691fb
ssome comments
def6b25a
more
2389cb63
axial rope type register separately
e03dbb12
forgot
bbc46e62
this is way too long
8837feed
i am making bad decisions, revert
852a0c86
return dtype is fp32 in most models
065b3214
ooops revert
fcb49bad
bit more, rest comes tmrw
38b9b1a4
i broke smth and i dont know what
620c64cc
need to fix repo again
401d8fa7
skip the test for vision rope for now, will add later more
560268a7
example
e71d0211
Revert "i am making bad decisions, revert"
66da48f0
zucchini-nlp
changed the title
axial as type
cd9593ef
Merge remote-tracking branch 'upstream/main' into rope-vision
5730c6a3
fix repo
4bb92027
fix repo again
393d036b
missing
51e2a1d9
gemma4
582bbcab
Merge branch 'main' into rope-vision
bf42b4f3
fix
00f123c6
Merge branch 'main' into rope-vision
0f94794b
comments
6e516e2a
new mrope with 2 sections only, no temporal!
e5717eba
fix repo
3e03811c
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub