NielsRogge/transformers

Pull Requests Commits

Make text input optional

NielsRogge committed 2 years ago

40e5739d

Update fast tokenizer design

NielsRogge committed 2 years ago

c784456a

Update slow tokenizer

NielsRogge committed 2 years ago

c414c96f

Fix copied from

NielsRogge committed 2 years ago

a2e26fcf

NielsRogge committed 2 years ago

36cfa672

More improvements

NielsRogge committed 2 years ago

9073b2da

Remove vis_special_token

NielsRogge committed 2 years ago

da03530e

NielsRogge committed 2 years ago

1c60b9ad

Rename seg_data to bbox

NielsRogge committed 2 years ago

f0697eb1

Rename image to pixel_values

NielsRogge committed 2 years ago

f1efcd05

Fix equivalence test

NielsRogge committed 2 years ago

b90f893b

NielsRogge committed 2 years ago

ec240a20

Fix tokenizer tests

NielsRogge committed 2 years ago

56fed4ab

Fix additional_special_tokens of fast tokenizer

NielsRogge committed 2 years ago

25fe67a4

NielsRogge committed 2 years ago

5d4bfd51

Enable fast tokenizer tests

NielsRogge committed 2 years ago

f6103bcd

Fix tokenizer tests

NielsRogge committed 2 years ago

f615c4ea

NielsRogge committed 2 years ago

83e82ad8

Fix one more test

NielsRogge committed 2 years ago

8bb2d2d9

Add tokenizer tests

NielsRogge committed 2 years ago

e46886a9

Use processor in conversion script

NielsRogge committed 2 years ago

ee581ae7

Add fast tokenizer

NielsRogge committed 2 years ago

b9d5c9cb

Add fully fledged tokenizer

NielsRogge committed 2 years ago

ee9f3cbc

NielsRogge committed 2 years ago

0d1723dd

Update README's

NielsRogge committed 2 years ago

f830e936

NielsRogge committed 2 years ago

13593f66

Add fast tokenizer

NielsRogge committed 2 years ago

0d839be9

Add UdopTokenizer

NielsRogge committed 2 years ago

bf9a592f

Improve conversion script

NielsRogge committed 2 years ago

553d6727

Add image processor

NielsRogge committed 2 years ago

1dd6b2a7

Older