Add TIPSv2 #46347
Ternura143
wants to merge
108 commits into
huggingface:main
from
Ternura143:add-tipsv2
Add TIPSv2
9ee98cf3
fix: fix-repo
a65b54a4
test: add inference test
876ab8e2
test: add inference test
52f1143e
move processing to modular
0f0b51ee
simplify Tipsv2Tokenizer
e3b9be33
Merge branch 'add-tipsv2' of hpc-cluster-hopper-login-node-1:/fsx/gua…
b3210a68
drop remote code test
9d672d70
remove redundant vision config attributes
8f6f7b19
make Tipsv2TextConfig inherit from Siglip2TextConfig
37289211
use modular for loss
603d6813
fix mlp_ratio in tests
673b7c63
Merge branch 'main' into add-tipsv2
a370b065
match clip outputs
165baa74
add configuration backwards compatibility handling
b50159d5
Merge branch 'add-tipsv2' of https://github.com/Ternura143/transforme…
d8b42cb3
fix so400m checkpoint
f46ca4b5
add temporary test
1bb2d063
clarifiy embeddings dtype
92d951db
update base_model_prefix
21238ce8
remove unused attributes
8140245e
add Tipsv2SinusoidalPositionalEmbedding
50f7d1b0
cleanup text attention
5fbb8697
inherit from CLIPEncoderLayer
8c11cac7
inherit from CLIPMLP
0c9891c3
inherit from CLIPEncoder
a9b8ef90
Merge branch 'main' into add-tipsv2
f04de536
remove valid_mask
d9b86acb
simplify text model _init_weights
c8d5a344
move config validation
1df0f83d
minor cleanup
ca023082
fix test
b44554a9
Merge branch 'main' into add-tipsv2
a3c15933
add Tipsv2VisionBackbone
3ca300ad
Merge branch 'add-tipsv2' of https://github.com/Ternura143/transforme…
3c9e0875
make temperature a learnable parameter
e63501f7
add tipsv2_dpt
0e55c939
make fix-repo
d19f5a21
add dpt tests
31b2c164
Merge branch 'main' into add-tipsv2
e8926064
cleanup tipsv2 tests
ce5d3b01
fix-repo
193872e5
fix conversion mapping
529af439
fix conversion mapping
a3002dd5
Merge branch 'add-tipsv2' of hpc-cluster-hopper-login-node-1:/fsx/gua…
ce0361dd
apply some fixes
dee6ad33
fix weight conversion
143c93bd
ignore unexpected keys
bca834e3
update test
f88c4431
Update conversion mapping
082743f2
update tests
457b608b
add post processing expected values
be33b650
fix tests
3c8a52bd
inherit from tipsv2imageprocessor
c31556d3
inherit from DPTReassembleLayer
dfc808b7
handle temperature and swiglu
5efc088d
Merge branch 'add-tipsv2' of hpc-cluster-hopper-login-node-1:/fsx/gua…
4c73c870
make fix-repo
a04cc945
inherit modules where possible
6963a3a6
fix depth activation
a4f2e90f
add bin regressor
16a2b650
fix regressor init
4172f896
cleanup patch size handling
04e7decc
cleanup init
410ba841
add depth_decoder_activation
7fe46485
add NormalEstimatorOutput
1f89d34c
raise error on labels
e12f2426
cleanup segmentation logits naming
54018031
cleanup class definition order
16e79afe
fix tests
eaadbfc1
cleanup tests
c56810c8
fix image processing tests
bc9b753f
fix image processing
5c6ac11c
update segmentation loss computation
377e95f8
cleanup configuration
d74002b7
cleanup processing docstrings
0ff78228
rename to Tipsv2DptFeaturesToDepth
e56cf83d
remove module docstring
bbc30aab
relax config validation
08113657
use Sapiens2NormalEstimatorOutput
12ad5cd7
cleanup docstrings
53437801
update tipsv2 docs
a68b179f
add tipsv2 dpt docs
e2c8bff6
handle original dpt configs
4519056d
fix block indices mapping
147df9d7
make fix-repo
628ebb54
add EmbeddingAccessMixin
9c8d02b4
use init.constant_
abac52ff
fix temperature docs value
b8226de8
update tokenizer
ef3fc68c
use temp repo
83bc98a2
fix tokenizer
978d7861
use temp repo everywhere
1b007392
remove config backwards compatibility
2ad10e7c
update docs
b470c657
update docs
cd09c3fb
add images to docs
ec7444f6
update weight mapping
ac6ff439
revert backbone mapping
fee6d505
try fix weight mapping
307e092b
cleanup conversion mapping
b536ac7d
style
934f1c88
update docstrings
4d40f217
update docstrings
16cad6b4
Merge branch 'main' into add-tipsv2
e5db2f75
Merge branch 'main' into add-tipsv2
eb036fef
add checkpoint to dpt config
a705fd76
guarin
commented
on 2026-06-22
add return_segmentation_scores
44dc263f
Login to write a write a comment.
Login via GitHub