PR #24709 Add `Kosmos-2` model

ydshieh force pushed from da2971f0 to 2b5a045f 2 years ago

ydshieh force pushed from 2b5a045f to fba0303d 2 years ago

ydshieh force pushed to 6edb6e2d 2 years ago

ydshieh force pushed to f400efd6 2 years ago

ydshieh force pushed from 0c99ca40 2 years ago

ydshieh force pushed to 2ab66a47 2 years ago

ydshieh force pushed to 723403a8 2 years ago

ydshieh force pushed 2 years ago

ydshieh changed the title ~~[WIP] Add `kosmos-2`~~ Add `Kosmos-2` model 2 years ago

ydshieh marked this pull request as ready for review 2 years ago

ydshieh force pushed to 9c6e954a 2 years ago

ydshieh commented on 2023-09-08

ydshieh requested a review from

amyeroberts 2 years ago

ydshieh requested a review from

ArthurZucker 2 years ago

ydshieh requested a review from

NielsRogge 2 years ago

amyeroberts approved these changes on 2023-09-08

ydshieh force pushed 2 years ago

ydshieh force pushed to b4fe4937 2 years ago

ydshieh force pushed from b4fe4937 to ad15fb2b 2 years ago

ArthurZucker commented on 2023-09-21

NielsRogge commented on 2023-09-27

ArthurZucker commented on 2023-09-28

ydshieh force pushed from b03057cf to 7ec1d2d0 2 years ago

ydshieh force pushed from 7ec1d2d0 to cf501abe 2 years ago

ydshieh requested a review from

ArthurZucker 2 years ago

ArthurZucker commented on 2023-10-20

ydshieh force pushed from 01b37ba1 to 436d3bc3 2 years ago

ydshieh force pushed from 436d3bc3 to ef9102ce 2 years ago

ArthurZucker approved these changes on 2023-10-25

Add KOSMOS-2 model

ab90b849

update

325865c2

update

97c226b2

update

bd9a5411

address review comment - 001

d06fcb69

address review comment - 002

cdad77d4

address review comment - 003

e53e4692

style

1138adb0

Apply suggestions from code review

c4b5e431

fix

58977ecc

address review comment - 004

4dbf3e13

address review comment - 005

0264eef7

address review comment - 006

b9ced380

address review comment - 007

303e65da

address review comment - 008

7d4c9ed8

address review comment - 009

a74bf291

address review comment - 010

64f823bf

address review comment - 011

a1b72c03

update readme

db77c8a0

fix

af81ef0c

fix

a9b8925b

fix

3b7a90d2

[skip ci] fix

2c019189

revert the change in _decode

5e1fe950

fix docstring

169364c2

fix docstring

20985729

Update docs/source/en/model_doc/kosmos-2.md

8cd95153

no more Kosmos2Tokenizer

0f74fedc

style

c6babb58

remove "returned when being computed by the model"

6efd3c33

Apply suggestions from code review

0b907f5c

UTM5 Atten

eed83d04

fix attn mask

1bd1f7f9

use present_key_value_states instead of next_decoder_cache

5fe028ec

style

2a390899

conversion scripts

1a7a068e

conversion scripts

4cca0c4a

conversion scripts

395dbcf2

Add _reorder_cache

9a6d2e2b

fix doctest and copies

4ca2b1df

rename 1

e88a4955

rename 2

30620aec

rename 3

f233e081

make fixup

5ad3914e

fix table

d2c2311c

fix docstring

45b61b6d

rename 4

6bd5b2bb

change repo_id

48f77ff2

remove tip

1d4b5ac8

update md file

6383476d

make style

89cffbe2

update md file

59656821

update md file

6383476d

make style

89cffbe2

update conversion script

61ef208f

Use CLIPImageProcessor in Kosmos2Processor

5b2b29dd

Remove Kosmos2ImageProcessor

8f088c14

Remove to_dict in Kosmos2Config

92f51bdf

Remove files

61347952

fix import

7c29934f

Update conversion

e4911eac

normalized=False

74b022d0

Not using hardcoded values like <image>

041b75f5

elt --> element

fd7e267f

Apply suggestion

c0be44d7

Not using hardcoded values like </image>

dd2ed982

No assert

d3eefbf2

No nested functions

15a2309d

Fix md file

65a45191

copy

0712158f

update doc

b225b136

fix docstring

f2335814

fix name

856bdc6d

Remove _add_remove_spaces_around_tag_tokens

472b4dde

Remove dummy docstring of _preprocess_single_example

a051ea74

Use `BatchEncoding`

38dd9d7f

temp

ba48faa9

temp

d76da955

temp

af0af4dd

Update

bfb91ebe

Update

f2b8b758

Make Kosmos2ProcessorTest a bit pretty

e2c360cb

Update gradient checkpointing

9d950e35

ydshieh force pushed from e7785afb to 9d950e35 2 years ago

Fix gradient checkpointing test

de7e19ac

Remove one liner remove_special_fields

fb572ab1

Simplify conversion script

a2998d1d

fix add_eos_token

bafdde7b

update readme

74ca72dc

update tests

151554e0

Change to microsoft/kosmos-2-patch14-224

0c809cb5

style

f29c324c

Fix doc

9ace07ab

ydshieh merged 691fd8fd into main 2 years ago

ydshieh deleted the add_kosmos_2 branch 2 years ago

transformers
Add `Kosmos-2` model
#24709

Merged

Add `Kosmos-2` model #24709

transformers Add `Kosmos-2` model #24709 Merged

Add `Kosmos-2` model #24709

transformers
Add `Kosmos-2` model
#24709

Merged