Add LightGlue model #31718
Cyrilvallez
merged
103 commits into
huggingface:main
from
sbucaille:add_lightglue
stevhliu
commented
on 2025-03-10
init
42d09d9a
chore: various changes to LightGlue
ee430373
chore: various changes to LightGlue
a48b942e
chore: various changes to LightGlue
14799d02
chore: various changes to LightGlue
0a54a43c
Fixed dynamo bug and image padding tests
444bc423
refactor: applied refactoring changes from SuperGlue's concat, batch …
a5804cbb
tests: removed sdpa support and changed expected values
a093215b
chore: added some docs and refactoring
2087f108
chore: fixed copy to superpoint.image_processing_superpoint.convert_t…
3634ae19
feat: adding batch implementation
36d2249a
feat: added validation for preprocess and post process method to Ligh…
f7004e75
chore: changed convert_lightglue_to_hf script to comply with new stan…
6f888dcf
chore: changed lightglue test values to match new lightglue config pu…
e828ad92
chore: simplified convert_lightglue_to_hf conversion map
45bf864f
feat: adding batching implementation
582a022a
chore: make style
3a1f9f43
feat: added threshold to post_process_keypoint_matching method
78cf7ef2
fix: added missing instructions that turns keypoints back to absolute…
c5a8df81
fix: added typehint and docs
c5a81aad
chore: make style
bd60938e
[run-slow] lightglue
a09a4ff2
fix: add matches different from -1 to compute valid matches in post_p…
0c965f55
tests: added CUDA proof tests similar to SuperGlue
1881324d
chore: various changes to modeling_lightglue.py
2cf1a669
chore: various changes to convert_lightglue_to_hf.py
db163fbb
chore: fixed imports in lightglue files
9686f217
[run-slow] lightglue
7a2269f9
chore: make style
5de6d175
chore: various changes to LightGlue
a48b942e
refactor: applied refactoring changes from SuperGlue's concat, batch …
a5804cbb
tests: removed sdpa support and changed expected values
a093215b
feat: added validation for preprocess and post process method to Ligh…
f7004e75
chore: changed convert_lightglue_to_hf script to comply with new stan…
6f888dcf
chore: changed lightglue test values to match new lightglue config pu…
e828ad92
feat: added threshold to post_process_keypoint_matching method
78cf7ef2
fix: added missing instructions that turns keypoints back to absolute…
c5a8df81
fix: added typehint and docs
c5a81aad
chore: make style
bd60938e
[run-slow] lightglue
a09a4ff2
chore: various changes to convert_lightglue_to_hf.py
db163fbb
chore: fixed imports in lightglue files
9686f217
[run-slow] lightglue
7a2269f9
[run-slow] lightglue
df9a1f25
fix: added missing grayscale argument in image processor in case use …
f2f254c7
fix: changed lightglue HF repo to lightglue_superpoint with grayscale…
74481241
refactor: refactor do_layer_keypoint_pruning
e6701678
tests: added tests with no early stop and keypoint pruning
b371d200
refactor: various refactoring to modeling_lightglue.py
61e43e21
refactor: added comments and renamed filter_matches to get_matches_fr…
6a16796e
tests: added copied from statement with superglue tests
cb8fb5a7
docs: added comment to prepare_keypoint_matching_output function in t…
cef63f00
[run-slow] lightglue
66f53a5c
docs: added Optional typehint to LightGlueKeypointMatchingOutput
72ba4cb7
chore: removed pad_images function
882677b2
chore: set do_grayscale default value to True in LightGlueImageProcessor
7364e687
Apply suggestions from code review
5f917e46
docs: added missing LightGlueConfig typehint in nn.Module __init__ me…
990ed452
refactor: set device variable
ea52fe2c
docs: added comments to reshape.flip.reshape instruction to perform c…
e445766b
refactor: used batched inference for keypoint detector forward pass
814297bc
fix: added fix for SDPA tests
733ae6eb
docs: fixed docstring for LightGlueImageProcessor
b764dd0e
[run-slow] lightglue
d8306121
refactor: added missing arguments in LightGlueConfig init method
d4c075aa
refactor: added checkpoint url as default variable to verify models o…
5f0f98a5
fix: moved print message inside if statement
cc1b2933
fix: added log assignment r removal in convert script
ea6ae20e
fix: got rid of confidence_thresholds as registered buffers
c529ade9
docs: changed copyright to 2025
845f47c7
fix: removed unnecessary import
79a3f3d1
fix: added missing import error for matplotlib
a46f72cf
Updated convert script to push on ETH org
73d807d0
fix: added missing licence
80b20152
fix: make fix-copies
c8b45503
refactor: use cohere apply_rotary_pos_emb function
b0b32959
refactor: add and use intermediate_size attribute in config to inheri…
a3f94d58
refactor: use can_return_tuple decorator in LightGlue model
8b5991a8
fix: make fix-copies
e24014d7
docs: Update model references in `lightglue.md` to use the correct pr…
c693c547
Refactor LightGlue configuration and processing classes
88048f03
refactor: removed Conv layers from init_weights since LightGlue doesn…
7bca51fb
refactor: simplify LightGlue image processing tests by inheriting fro…
87618ace
test: forced eager attention implementation to LightGlue model tests
bb60d255
refactor: update LightGlue model references
d9140958
fix: import error
b7bae3cd
test: enhance LightGlue image processing tests with setup method
fe3d6e76
refactor: added LightGlue image processing implementation to modular …
5eab8c4c
refactor: moved attention blocks into the transformer layer
2aeff710
fix: added missing import
0e4dac66
fix: added missing import in __all__ variable
d2c242c2
Cyrilvallez
approved these changes
on 2025-06-17
doc: added comment about enforcing eager attention because of SuperPoint
347b5dce
refactor: added SuperPoint eager attention comment and moved function…
a7bb4a86
Cyrilvallez
approved these changes
on 2025-06-17
Reviewers
Assignees
No one assigned
Labels
New model
Vision
run-slow
Milestone
No milestone
Login to write a write a comment.
Login via GitHub