transformers
Add Segment Anything Model (SAM)
#22654
Merged
Overview
Commits
184
Changes
View On GitHub

Add Segment Anything Model (SAM) #22654

ArthurZucker merged 184 commits into huggingface:main from ArthurZucker:add-sam
ArthurZucker
ArthurZucker initial commit
0d59baa4
younesbelkada keys match
8798e621
younesbelkada update, fix conversion
4acf7a2b
younesbelkada fixes, inference working
b0e29947
younesbelkada fix
cd5cd0a6
younesbelkada more fixes
589a9fc1
younesbelkada more fixes
17e624c5
younesbelkada clean up
f43619a4
younesbelkada more clean up
8c30ac3f
ArthurZucker
ArthurZucker commented on 2023-04-11
ArthurZucker fix copies and add convext copied layer norm
dd19b15b
ArthurZucker stash
17aeb1b7
ArthurZucker pretty big upfate
f02408f3
ArthurZucker cleaning
a062a2a7
ArthurZucker more cleaning
35722987
ArthurZucker fixup stuffs
878c9c5e
ArthurZucker fix copies
4eb3eb11
ArthurZucker fix iinit
15937e70
ArthurZucker update test removing tokenizer
bd7d2b4d
ArthurZucker nits
5370e359
ArthurZucker add pretrained
51be4cc8
ArthurZucker more nits
5d4ea591
ArthurZucker remove tracking of pipeline
e7404638
younesbelkada few fixes
5e2c4eaa
ArthurZucker update san and conversion script
3840fcda
younesbelkada fix mask decoder and prompt encoder conversion
63a6f759
younesbelkada Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
71c53774
younesbelkada fixes
12232d77
ArthurZucker small update
272a4709
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
89d82807
ArthurZucker fix order
01e6b575
younesbelkada fix
93c5185b
younesbelkada Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
b179571e
younesbelkada fix image embeddings
2ad8e6dd
ArthurZucker nites
1d503cb0
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
e754719c
younesbelkada few fixes
dba2be37
younesbelkada fix logits
854b01b4
younesbelkada clean up
7409029f
younesbelkada fixes boxes inference
23d358ac
younesbelkada v1 AMG
2e89bed6
younesbelkada clean up
a770a51d
younesbelkada some clean up
bb40cb01
younesbelkada multi points support
30da5089
younesbelkada amg working
c4408c7e
younesbelkada fixup
4a3b75f3
younesbelkada clean up
88757f3e
younesbelkada readme
e2e88d05
younesbelkada update toctree
a246c964
younesbelkada younesbelkada changed the title [SAM] Add sam model [WIP] Add Segment Anything Model (SAM) 3 years ago
younesbelkada fix type hint
a4475631
younesbelkada multiple fixes
b9fcddd9
younesbelkada fixup
98bf9225
younesbelkada fixes
2a78a319
HuggingFaceDocBuilderDev
younesbelkada updates
70c7c611
younesbelkada updates
6b21e687
younesbelkada more tests
bc8c1b89
younesbelkada few fixes
96e320f9
younesbelkada Merge remote-tracking branch 'upstream/main' into HEAD
09ccaeaa
younesbelkada change to `SamForMaskGeneration`
f382b8d4
younesbelkada doc
1c317db4
ArthurZucker fixup
2729dbc0
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
39d611cf
younesbelkada fix more tests
5de1b083
younesbelkada multiple fixes
073e730a
younesbelkada fix CI tests
2d27b471
younesbelkada refactor processor
7efbba24
ArthurZucker renamings
d467dbd2
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
0d9e20fb
ArthurZucker draft the pipeline
25c569b3
younesbelkada refactor
7c896b07
younesbelkada Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
88101456
younesbelkada fix tests
9ffb2e15
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
47b12d1c
younesbelkada fix test
20b90b9e
younesbelkada few cleanings
aea7c6a3
younesbelkada fix test
ba7a851f
ArthurZucker edit pipelien support chunking
2135c853
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
57209703
ArthurZucker udate
4cfc51de
younesbelkada add slow tests
c995f9f3
younesbelkada fix nit
2a8399d6
younesbelkada fixup
2c60040f
younesbelkada fix nit
de963b83
ArthurZucker current chunk pipleine
5247ee26
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
80158a42
ArthurZucker
ArthurZucker commented on 2023-04-17
ArthurZucker
ArthurZucker commented on 2023-04-17
ArthurZucker
ArthurZucker commented on 2023-04-17
younesbelkada cast boxes in fp32
be3fa6cd
younesbelkada Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
812359ea
younesbelkada nit
8504910d
younesbelkada
ArthurZucker current updates
b515a627
ArthurZucker piepleine works
403cf445
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
e426f3ba
ArthurZucker fixup
af4a7e32
younesbelkada clean up config
bc2a2da0
younesbelkada
younesbelkada commented on 2023-04-18
younesbelkada fix slow tests
116b13a2
younesbelkada fix slow tests
ad34e9de
younesbelkada clean up
1926bc14
ArthurZucker update doc and pipeline
4a0532e7
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
c8962537
younesbelkada adds more slow tests
88f2463d
younesbelkada Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
7b123aab
younesbelkada fix slow tests
3ff5bfca
ArthurZucker cleaning
ff87e20f
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
97fb32b7
younesbelkada tests pass
88f84532
younesbelkada add docstring
cf5158ef
younesbelkada fix copies
1f17915e
younesbelkada clean up
bb48be98
ArthurZucker support batch of images
dfccc0d2
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
46e0ff1e
ArthurZucker style
6df95002
ArthurZucker dummy is needed, add tests
ed99b549
younesbelkada fix slow tests
c98e4c0d
younesbelkada Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
dd676bef
younesbelkada fix CI
577d285f
ArthurZucker update
afb449f8
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
3a4f5e83
younesbelkada adds more tests
fd4dc82b
younesbelkada Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
64351873
younesbelkada fixes
c32f43aa
younesbelkada fixes
9886a53b
younesbelkada fixup
8b313a0e
younesbelkada fixes
21e2f7e6
younesbelkada few fixes
b4a7e8b5
younesbelkada filter
9ffbc69f
younesbelkada few fixes
bbdd2ee5
younesbelkada some refactor
1950a167
younesbelkada touches finales
1320e36e
younesbelkada younesbelkada changed the title [WIP] Add Segment Anything Model (SAM) Add Segment Anything Model (SAM) 3 years ago
younesbelkada fix
0fc86805
ArthurZucker style
e996e014
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
a5d8e92b
ArthurZucker remove pipeline files
53499e36
younesbelkada fixes nits
d4c4de9f
ArthurZucker revert pipeline changes
0115cd93
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
75448c3a
younesbelkada fix test
8b60f3ae
younesbelkada younesbelkada marked this pull request as ready for review 3 years ago
ArthurZucker fixup
f326dfa7
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
53a9f0e5
ArthurZucker
ArthurZucker commented on 2023-04-18
ArthurZucker remove automodel for automatic mask generation
0b578366
ArthurZucker fix failing torch tests
9f80285b
ArthurZucker
ArthurZucker ArthurZucker requested a review from amyeroberts amyeroberts 3 years ago
ArthurZucker ArthurZucker requested a review from sgugger sgugger 3 years ago
sgugger
sgugger commented on 2023-04-18
amyeroberts
amyeroberts commented on 2023-04-18
ArthurZucker update mdx
88b7ac96
ArthurZucker revert removal of `MODEL_FOR_AUTOMATIC_MASK_GENERATION_MAPPING`
fc898cab
ArthurZucker update sam config based on review
8e86426e
ArthurZucker update low_resolution_masks -> pred_masks
818f4765
ArthurZucker update processor docstring
480b8e36
ArthurZucker remove image processor import empty
ae795461
ArthurZucker update for testing
6cccfb36
ArthurZucker output vision hidden states + clean recomm
2cb2d9e8
ArthurZucker fixup
2d1b3bc3
ArthurZucker fixup
e5b0af9d
ArthurZucker remove unused
61a9ef55
ArthurZucker Update src/transformers/models/sam/modeling_sam.py
e121384a
ArthurZucker Update src/transformers/models/sam/image_processing_sam.py
cdb8c076
ArthurZucker nits
f9508f1f
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
cd9a8e8b
younesbelkada fix
db415542
younesbelkada fix CI tests and slow tests
8eae6efe
younesbelkada replace with Amy's processor
93a504c9
younesbelkada clearer docstring
8440530e
younesbelkada add `SamVisionNeck`
93e1364f
younesbelkada refactor - all CI tests should pass
58001145
younesbelkada younesbelkada requested a review from amyeroberts amyeroberts 3 years ago
younesbelkada younesbelkada requested a review from sgugger sgugger 3 years ago
younesbelkada fix broken import on Gcolab
7228cb8a
younesbelkada few fixes here and there
0c61d3b2
younesbelkada fix another bug
d7e805d9
sgugger
sgugger commented on 2023-04-19
younesbelkada fix more bugs
731d416f
ArthurZucker update and merge
08eaaf93
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
81be02c1
younesbelkada correct ckpt
c931b550
younesbelkada address comments
932a4796
younesbelkada add tips
d71cabf9
younesbelkada revert
bbcbad12
younesbelkada fix docstring
4000130d
younesbelkada younesbelkada requested a review from sgugger sgugger 3 years ago
younesbelkada younesbelkada removed review request from sgugger sgugger 3 years ago
younesbelkada replace with `SamModel`
b921294c
younesbelkada make fixup
5810f28a
younesbelkada younesbelkada requested a review from sgugger sgugger 3 years ago
ArthurZucker add support for bathed images and batch ed points
44542dcd
ArthurZucker Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
cdb6abaa
younesbelkada make fixup this time, really
b1f16867
younesbelkada Merge branch 'add-sam' of https://github.com/ArthurZucker/transformer…
b391539d
younesbelkada make fixup again and again
2e44dd2f
younesbelkada few fixes here and there, this should be the touche finale
46c89377
sgugger
sgugger approved these changes on 2023-04-19
younesbelkada
younesbelkada commented on 2023-04-19
younesbelkada Update docs/source/en/model_doc/sam.mdx
ce8b35fc
younesbelkada fixup
533d637a
younesbelkada correct checkpoints
8308f3f4
younesbelkada correct name
d958f144
younesbelkada rm unneeded file
8422b8fa
younesbelkada add notebook
fb3827ac
ArthurZucker
ArthurZucker ArthurZucker merged 474bf508 into main 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum