transformers
🚨 Add Blip2ForImageTextRetrieval
#29261
Merged
Overview
Commits
38
Changes
View On GitHub

🚨 Add Blip2ForImageTextRetrieval #29261

amyeroberts merged 38 commits into huggingface:main from jpizarrom:add_blip2_image_text_retrieval_model
jpizarrom
jpizarrom jpizarrom marked this pull request as draft 2 years ago
jpizarrom
jpizarrom commented on 2024-02-23
jpizarrom jpizarrom marked this pull request as ready for review 2 years ago
jpizarrom jpizarrom changed the title WIP Add Blip2ForImageTextRetrieval Add Blip2ForImageTextRetrieval 2 years ago
ArthurZucker
jpizarrom jpizarrom changed the title Add Blip2ForImageTextRetrieval 🚨 Add Blip2ForImageTextRetrieval 2 years ago
jpizarrom
amyeroberts
jpizarrom jpizarrom force pushed 1 year ago
jpizarrom jpizarrom requested a review from amyeroberts amyeroberts 1 year ago
amyeroberts
amyeroberts commented on 2024-03-27
github-actions
jpizarrom add Blip2ForImageTextRetrieval
e1063407
jpizarrom use one line and remove unnecessary space in tests
164d824c
jpizarrom use value from the config, rather than hardcoded
715f6fa7
jpizarrom change order of params in Blip2QFormerModel.forward
da0cc831
jpizarrom jpizarrom changed the title 🚨 Add Blip2ForImageTextRetrieval WIP 🚨 Add Blip2ForImageTextRetrieval 1 year ago
jpizarrom jpizarrom force pushed to da0cc831 1 year ago
jpizarrom update docstring
02a0e08b
jpizarrom fix style
360f5372
jpizarrom update test_inference_opt
5e7764f5
jpizarrom move embeddings out of Blip2QFormerModel
7e7135a3
NielsRogge
NielsRogge commented on 2024-05-01
NielsRogge
NielsRogge commented on 2024-05-01
NielsRogge
NielsRogge requested changes on 2024-05-01
jpizarrom remove from_vision_qformer_configs
258f349a
NielsRogge
NielsRogge commented on 2024-05-01
NielsRogge
NielsRogge commented on 2024-05-01
NielsRogge
NielsRogge commented on 2024-05-01
jpizarrom remove autocast float16 in Blip2QFormerModel
cf42e9b0
jpizarrom rename fiels into vision_projection,text_projection,use_image_text_ma…
82160853
github-actions github-actions closed this 1 year ago
jpizarrom use CLIPOutput for Blip2ImageTextMatchingModelOutput
e2781cb2
jpizarrom jpizarrom changed the title WIP 🚨 Add Blip2ForImageTextRetrieval WIP 🚨 Add Blip2ForImageTextRetrieval 1 year ago
jpizarrom jpizarrom changed the title WIP 🚨 Add Blip2ForImageTextRetrieval 🚨 Add Blip2ForImageTextRetrieval 1 year ago
NielsRogge NielsRogge reopened this 1 year ago
jpizarrom jpizarrom requested a review from NielsRogge NielsRogge 1 year ago
jpizarrom remove past_key_values_length from Blip2TextEmbeddings
1c9746d1
NielsRogge
NielsRogge commented on 2024-05-23
NielsRogge
NielsRogge commented on 2024-05-23
NielsRogge
NielsRogge commented on 2024-05-23
NielsRogge
NielsRogge commented on 2024-05-23
NielsRogge
NielsRogge commented on 2024-05-23
NielsRogge
NielsRogge commented on 2024-05-23
NielsRogge
NielsRogge approved these changes on 2024-05-23
jpizarrom fix small typo in the CLIPOutput docstring
e6da6380
jpizarrom add Blip2ForImageTextRetrieval to Zero Shot Image Classification mapping
c65ea336
NielsRogge
jpizarrom
NielsRogge
jpizarrom Merge remote-tracking branch 'upstream/main' into add_blip2_image_tex…
a39f9fdf
jpizarrom
NielsRogge
jpizarrom Merge remote-tracking branch 'upstream/main' into add_blip2_image_tex…
a2b99a95
jpizarrom
ydshieh
jpizarrom Merge remote-tracking branch 'upstream/main' into add_blip2_image_tex…
64689477
NielsRogge NielsRogge requested a review from amyeroberts amyeroberts 1 year ago
HuggingFaceDocBuilderDev
amyeroberts
amyeroberts commented on 2024-06-04
jpizarrom
jpizarrom update docstring and add require_torch_fp16
9bda9799
jpizarrom rollback test_inference_opt
efa80418
jpizarrom use use_image_text_matching_head=True in convert
cb7beae5
jpizarrom Merge remote-tracking branch 'upstream/main' into add_blip2_image_tex…
05cb8d4c
jpizarrom skip test_model_get_set_embeddings
8eca5e5e
amyeroberts
amyeroberts approved these changes on 2024-06-12
jpizarrom
jpizarrom
jpizarrom commented on 2024-06-16
NielsRogge
jpizarrom fix create_rename_keys error on new itm fields
e31b7e55
jpizarrom revert to do scale after dot product between "query" and "key"
8808b8ae
jpizarrom fix ValueError on convert script for blip2-opt-2.7b
0a725670
NielsRogge
jpizarrom
huggingface huggingface deleted a comment from github-actions on 2024-07-23
amyeroberts
atomwalk12
NielsRogge
amyeroberts amyeroberts added run-slow
amyeroberts
jpizarrom update org of paths to Salesforce
2534ca38
jpizarrom Merge remote-tracking branch 'upstream/main' into add_blip2_image_tex…
af538401
jpizarrom add is_pipeline_test_to_skip for VisualQuestionAnsweringPipelineTests
f841c591
jpizarrom [run_slow] blip_2
1720ba4c
jpizarrom removed Blip2ForImageTextRetrieval from IGNORE_NON_AUTO_CONFIGURED
11f05793
jpizarrom jpizarrom requested a review from NielsRogge NielsRogge 1 year ago
NielsRogge
NielsRogge commented on 2024-08-11
NielsRogge
NielsRogge commented on 2024-08-11
jpizarrom fix docstring of Blip2ImageTextMatchingModelOutput
5e63cdb3
jpizarrom [run_slow] blip_2
95232f87
jpizarrom fix multi-gpu tests
04bb8608
jpizarrom [run_slow] blip_2
5c66e50c
jpizarrom Merge remote-tracking branch 'upstream/main' into add_blip2_image_tex…
2419c85e
jpizarrom Merge remote-tracking branch 'upstream/main' into add_blip2_image_tex…
53abc06b
jpizarrom [run_slow] blip_2
d32e8894
jpizarrom
jpizarrom commented on 2024-08-13
jpizarrom
atomwalk12
amyeroberts
jpizarrom
amyeroberts amyeroberts merged 7591ca5b into main 1 year ago
KilianKW
jpizarrom
jpizarrom jpizarrom deleted the add_blip2_image_text_retrieval_model branch 1 year ago
KilianKW
NielsRogge
KilianKW
NielsRogge

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
run-slow
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum