Add new model: Isaac #45186
zucchini-nlp
wants to merge
96 commits into
huggingface:main
from
zucchini-nlp:isaac-main
initial isaac implementation
63cd4a0d
style: fixing assorted PR notes
63d1b1b6
fix: get modular convert utility working
d72311d8
feat: modular convert utility outputs
d6ed8440
Merge pull request #1 from perceptron-ai-inc/pg/update_isaac
7f4944f5
chore: port updates
c3cc42d0
fix: update imports
965215cc
fix: adjust typing to get modular convert script working
4c4f1c94
feat: modular convert utility outputs
021a1aee
Merge pull request #2 from perceptron-ai-inc/pg/update_isaac
6311fd2d
feat: port updates to isaac
3d8b786a
fix: changes to enable modular convert
92f56b81
chore: modular convert script artifacts
70bcc770
style: remove redundant registration
5656b833
style: organize auto file entries
963f8c1b
style: lints
74f9f3be
fix: processor typing
f56f064f
fix: allow image processor typing
4c5c19d3
style: | for unions
8a95e64e
fix: don't alias siglip
25523ba8
fix: rename vision config to config to be consistent with base class
d1dc712c
fix: additional remakes
d80c9f6b
chore: convert artifacts
58d73116
style: make style changes
ffb3b9f2
refactor: bespoke isaac config
92c36d49
style: ruff organize imports
79eb96bf
chore: convert configuration artifact
1c6479aa
fix: get imports in
28992165
style: string typing of qwen2
aec77214
fix: remove image processor and tokenizer typing
c0b10b64
fix: enable qwen_2_5_vl import
302374d3
style: remove unnecessary copy text
de9dc808
fix: fix copies
107ecded
style: pass kwargs and docstrings
fd5e399e
chore: artifact
206b82a1
style: revert UP045 typing for autodocstring to work
510eb05f
Merge branch 'main' into main
887ff820
Merge branch 'main' into pg/update_isaac
e8d8b769
fix: latest transformers changes
5da40566
chore: new transformers convert
4a978896
again
0d553958
fix: export pretrained model
287a461d
test: add placeholder tests
c43cb5de
docs: add seed documentation
c84df288
docs: point to isaac model checkpoint
bf432bcc
fix: set config fields in model
080f22dc
docs: add dates stamp
0764c2cb
Update isaac.md
43f8b817
Merge pull request #3 from perceptron-ai-inc/pg/isaac_passes_make_fixup
665665ec
Merge branch 'main' into main
8c722b1e
Isaact e2e tests + passing make fixup (#4)
05900252
Merge branch 'main' into main
3a6e1c64
fix: update TensorType import for latest changes in transformers main…
04630990
Merge branch 'main' into main
762032c1
fix: updates for v5 standards (#6)
95296b7e
Merge branch 'main' into main
0bd5ac03
feat: guard perceptron imports (#7)
1cb3c4b2
fix: guard PIL import (#8)
d439313f
fix: guard perceptron PIL and torch imports for CI (#9)
e2fe9f96
review revisions (#10)
257f47c8
Merge branch 'main' into main
f826763b
Merge branch 'main' into main
03ca8c78
transformers attention interface + modeling test suite (#11)
aa31c36a
Update src/transformers/models/isaac/modular_isaac.py
9226a9ca
Update src/transformers/models/isaac/modular_isaac.py
a1892a57
Update src/transformers/models/isaac/modular_isaac.py
82f25d6d
style: review revisions (#12)
5422d9d2
review changes (#13): separate projector class, removed redundant cas…
f4a63748
Merge branch 'main' into main
f86ba818
Squash merge pg/refactor_remove_tensorstream into main
abba38b1
Merge branch 'main' into main
8de326ee
feat: batched inference + rope refactor
2b696982
Update src/transformers/models/isaac/modular_isaac.py
2884211d
Squash merge into main
fdbd6333
style: alias norm to communicate scope
6ba2fdb7
Merge branch 'main' into main
33fcd574
refactor: no packed batch inference (#14)
57cbd794
Merge branch 'main' into main
f2491e8b
feat: rely on qwen3 backbone, flatten vision components, misc style c…
bf501ddb
Merge branch 'main' into main
22ce1679
Merge branch 'main' into main
c5514ac0
feat: config updates, image processor backend, assorted changes/tests…
778d8c5a
Merge branch 'main' into main
231aa23e
style: cleanup (#17)
67ae690a
style: unify image attention mask + import update (#18)
bbd8289a
style: further mask threading simplification + processing docstring (…
ed8fc0a1
Merge branch 'main' into main
ef3c6f7f
test: update tests
caf377c5
Merge branch 'main' into main
048094d4
Merge branch 'main' into main
748c82b6
Merge branch 'main' into main
7c6ca571
Squash merge pg/additional_cleanup into main
8b96e5f2
check repo fixes
81206dbc
add correct date
86235d40
fix: make the pointing types belong to processor class
e99bbc1a
clean up and rearrange code
a44952c6
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub