NielsRogge/transformers

Pull Requests Commits

Update slow tokenizer

NielsRogge committed 2 years ago

046af963

Fix copied from

NielsRogge committed 2 years ago

40daf9ed

NielsRogge committed 2 years ago

5e13f27e

More improvements

NielsRogge committed 2 years ago

83eefe3a

Remove vis_special_token

NielsRogge committed 2 years ago

5ca51ffd

NielsRogge committed 2 years ago

4b536436

Rename seg_data to bbox

NielsRogge committed 2 years ago

a9d290d8

Rename image to pixel_values

NielsRogge committed 2 years ago

ee554d78

Fix equivalence test

NielsRogge committed 2 years ago

a6db86eb

NielsRogge committed 2 years ago

90463a88

Fix tokenizer tests

NielsRogge committed 2 years ago

34b96407

Fix additional_special_tokens of fast tokenizer

NielsRogge committed 2 years ago

98b31072

NielsRogge committed 2 years ago

e431d836

Enable fast tokenizer tests

NielsRogge committed 2 years ago

7af706b9

Fix tokenizer tests

NielsRogge committed 2 years ago

cab7f721

NielsRogge committed 2 years ago

27b0ffd0

Fix one more test

NielsRogge committed 2 years ago

360beb3c

Add tokenizer tests

NielsRogge committed 2 years ago

19daee6d

Use processor in conversion script

NielsRogge committed 2 years ago

a7b25128

Add fast tokenizer

NielsRogge committed 2 years ago

68a722a1

Add fully fledged tokenizer

NielsRogge committed 2 years ago

92c88c31

NielsRogge committed 2 years ago

2d5af657

Update README's

NielsRogge committed 2 years ago

9dde3951

NielsRogge committed 2 years ago

5ca99d35

Add fast tokenizer

NielsRogge committed 2 years ago

a7930fa7

Add UdopTokenizer

NielsRogge committed 2 years ago

b7d370d5

Improve conversion script

NielsRogge committed 2 years ago

5f9c0abe

Add image processor

NielsRogge committed 2 years ago

12abe39b

Use real inputs for conversion script

NielsRogge committed 2 years ago

ef42988c

Extend conversion script

NielsRogge committed 2 years ago

b4cbb577

Newer Older