transformers
Add SigLIP
#26522
Merged
Overview
Commits
99
Changes
View On GitHub

Add SigLIP #26522

ArthurZucker merged 99 commits into huggingface:main from NielsRogge:add_siglip
NielsRogge
HuggingFaceDocBuilderDev
github-actions
github-actions github-actions closed this 2 years ago
NielsRogge NielsRogge reopened this 2 years ago
NielsRogge NielsRogge force pushed 2 years ago
NielsRogge NielsRogge force pushed 2 years ago
ArthurZucker
ArthurZucker commented on 2023-11-29
NielsRogge Add first draft
091ffff4
NielsRogge Use appropriate gelu function
7e66228d
NielsRogge More improvements
d3410104
NielsRogge More improvements
432ec566
NielsRogge More improvements
3d700aec
NielsRogge Convert checkpoint
61e98d1a
NielsRogge More improvements
4cfb533c
NielsRogge Improve docs, remove print statements
7bd5816e
NielsRogge More improvements
85e8efa8
NielsRogge Add link
5017a6a4
patil-suraj remove unused masking function
f07af7c2
patil-suraj begin tokenizer
64960412
patil-suraj do_lower_case
fcd729f5
patil-suraj debug
3cc8b4f5
patil-suraj set split_special_tokens=True
9e02a78d
NielsRogge Remove script
13f3f814
NielsRogge Fix style
c3818386
NielsRogge Fix rebase
82cd61b9
NielsRogge Use same design as CLIP
35fb3dcc
NielsRogge Add fast tokenizer
eb8748bd
NielsRogge Add SiglipTokenizer to init, remove extra_ids
59a616c6
NielsRogge Improve conversion script
da43b79f
NielsRogge Use smaller inputs in conversion script
9bf7faf5
NielsRogge Update conversion script
d40ed625
NielsRogge More improvements
59c2ed68
NielsRogge Add processor to conversion script
0d8e4b25
NielsRogge Add tests
5f982d23
NielsRogge Remove print statements
ed32e1fe
NielsRogge Add tokenizer tests
93c2eecd
NielsRogge Fix more tests
40bb3c03
NielsRogge More improvements related to weight initialization
e71278f8
NielsRogge More improvements
a6dcdbf1
NielsRogge Make more tests pass
b65ce001
NielsRogge More improvements
b210f0db
NielsRogge More improvements
3eaf473d
NielsRogge Add copied from
8de18230
NielsRogge Add canonicalize_text
6e44b7f2
NielsRogge Enable fast tokenizer tests
dd94da35
NielsRogge More improvements
1f1dc25b
NielsRogge Fix most slow tokenizer tests
da5a0d9b
NielsRogge Address comments
ec0e0371
NielsRogge Fix style
5b1dab16
NielsRogge NielsRogge force pushed to 5b1dab16 2 years ago
NielsRogge Remove script
e2e6dc9a
xenova
xenova requested changes on 2023-12-04
xenova
xenova commented on 2023-12-05
ArthurZucker ArthurZucker requested a review from ArthurZucker ArthurZucker 2 years ago
ArthurZucker
ArthurZucker
ArthurZucker commented on 2023-12-13
NielsRogge Address some comments
bf0e06df
NielsRogge Add copied from to tests
ca53b4e4
NielsRogge Add more copied from
e4c991d6
NielsRogge Add more copied from
28ef8637
NielsRogge Add more copied from
d3d53630
NielsRogge Remove is_flax_available
e6c3d304
NielsRogge Fix merge
8d099d18
NielsRogge More updates
d20a7bda
NielsRogge Address comment
5c403a55
NielsRogge Remove SiglipTokenizerFast for now
395ec005
NielsRogge Add caching
96ddb2f4
NielsRogge Remove umt5 test
1cb8436e
NielsRogge Add canonicalize_text inside _tokenize, thanks Arthur
f6b8b1e4
NielsRogge Fix image processor tests
746297b7
NielsRogge Skip tests which are not applicable
5390e870
NielsRogge Skip test_initialization
0b68b5f6
NielsRogge More improvements
e6045e74
NielsRogge Compare pixel values
9e25c117
NielsRogge Fix doc tests, add integration test
0fe9ddd7
NielsRogge Add do_normalize
c7ae7b00
NielsRogge Remove causal mask and leverage ignore copy
3a7c4734
NielsRogge Fix attention_mask
60826769
NielsRogge Fix remaining tests
35d35a9d
NielsRogge Fix dummies
b4b129c6
NielsRogge Rename temperature and bias
30d8b5ef
NielsRogge NielsRogge requested a review from ArthurZucker ArthurZucker 2 years ago
ArthurZucker
ArthurZucker commented on 2023-12-19
NielsRogge Address comments
fe4a5442
NielsRogge Add copied from to tokenizer tests
a159f930
NielsRogge Add SiglipVisionModel to auto mapping
bfa7013f
NielsRogge Add copied from to image processor tests
888fcb8e
NielsRogge
NielsRogge commented on 2023-12-19
NielsRogge Improve doc
c78ab3ef
ydshieh
NielsRogge Remove SiglipVisionModel from index
d5bafa82
ArthurZucker
ydshieh
ArthurZucker
ydshieh
ArthurZucker
ArthurZucker commented on 2023-12-20
NielsRogge Address comments
c161c49f
NielsRogge Improve docs
446b1502
NielsRogge Simplify config
20de3094
NielsRogge Add first draft
c5590c9b
NielsRogge Make it like mistral
01738d26
NielsRogge More improvements
ae59c65e
NielsRogge Fix attention_mask
10479dac
NielsRogge Fix output_attentions
9a74702a
NielsRogge Add note in docs
70e49be7
NielsRogge
ArthurZucker
ArthurZucker approved these changes on 2023-12-22
xenova
NielsRogge Convert multilingual model
28bf56bd
NielsRogge Convert large checkpoint
a5258fd7
NielsRogge Convert more checkpoints
58f46ffb
NielsRogge Add pipeline support, correct image_mean and image_std
41bb11d7
NielsRogge
NielsRogge Use padding=max_length by default
58937fb4
NielsRogge Make processor like llava
15dc528a
NielsRogge Add code snippet
3764b478
NielsRogge Convert more checkpoints
5ab84a3e
NielsRogge Set keep_punctuation_string=None as in OpenCLIP
985a9227
NielsRogge Set normalized=False for special tokens
ffdcfc5d
NielsRogge NielsRogge force pushed to ffdcfc5d 2 years ago
NielsRogge Fix doc test
f678d4cd
NielsRogge
ArthurZucker ArthurZucker requested a review from ArthurZucker ArthurZucker 2 years ago
NielsRogge Update integration test
e8b82303
NielsRogge NielsRogge force pushed to e8b82303 2 years ago
NielsRogge Add figure
ed40ec5f
NielsRogge Update organization
8c83814b
ArthurZucker
ArthurZucker approved these changes on 2024-01-08
NielsRogge Happy new year
4a0e70cf
NielsRogge Use AutoModel everywhere
5e3df736
ArthurZucker ArthurZucker merged 3b742ea8 into main 2 years ago
VictorSanh
NielsRogge
VictorSanh
xenova
VictorSanh
amyeroberts
VictorSanh
HugoLaurencon
amyeroberts
davidgxue
davidgxue commented on 2024-05-07
rootAvish
NielsRogge

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum