NielsRogge/transformers

Pull Requests Commits

More improvements

NielsRogge committed 3 years ago

724c4445

NielsRogge committed 3 years ago

25413af2

NielsRogge committed 3 years ago

7a6f9f5b

Merge pull request #33 from SaulLu/modeling_markuplm_add_test

NielsRogge committed 3 years ago

Verified be5f80e9

add `tags_dict` to `tokenizer_config` in fast version

SaulLu committed 3 years ago

f2c8fe8d

NielsRogge committed 3 years ago

ac1fe638

add new test to check if the tags_dict is correctly saved into `tokenizer_config.json`

SaulLu committed 3 years ago

0d62685b

Merge branch 'modeling_markuplm' of https://github.com/NielsRogge/transformers into modeling_markuplm

NielsRogge committed 3 years ago

615b6508

Merge pull request #32 from SaulLu/modeling_markuplm_fix_save_pretrained

NielsRogge committed 3 years ago

Verified 397e5155

Remove unused files

NielsRogge committed 3 years ago

cbfdbda0

add `"tokenizer_file"` to `VOCAB_FILES_NAMES` in `tokenization_makuplm.py`

SaulLu committed 3 years ago

5dda2415

Fix auto models

NielsRogge committed 3 years ago

4aa70ba0

add test tokenize equality output `tokenize` method between slow and fast

SaulLu committed 3 years ago

d0cd5780

Revert "replace `microsoft/markuplm-` by `SaulLu/markuplm-`"

SaulLu committed 3 years ago

c011ad82

SaulLu committed 3 years ago

db3b9616

SaulLu committed 3 years ago

c2a07b96

handle `tag_dict` as a dict object and not as a path

SaulLu committed 3 years ago

f8db0cd3

remove `tags_dict` from files lists

SaulLu committed 3 years ago

dedb77c2

replace `microsoft/markuplm-` by `SaulLu/markuplm-`

SaulLu committed 3 years ago

036a1a97

NielsRogge committed 3 years ago

a82212ff

Fix saving of tags_dict tres

NielsRogge committed 3 years ago

6a44df4c

Fix saving of tags_dict bis

NielsRogge committed 3 years ago

944b93b2

Fix saving of tags_dict

NielsRogge committed 3 years ago

42ee3640

Make more tests pass

NielsRogge committed 3 years ago

12c0695c

Make more tests pass

NielsRogge committed 3 years ago

ada0a20b

Make more tests pass

NielsRogge committed 3 years ago

4e97ff27

Fix saving of tags_dict for fast tokenizer

NielsRogge committed 3 years ago

ee27bba2

NielsRogge committed 3 years ago

85f6c654

Improve tokenizer tests

NielsRogge committed 3 years ago

aae16c36

NielsRogge committed 3 years ago

ef3632de

Older