NielsRogge/transformers

Pull Requests Commits

Update processor tests for both slow and fast tokenizers

NielsRogge committed 3 years ago

c53d85e4

Add support for fast tokenizer to the processor

NielsRogge committed 3 years ago

30f16b0f

Add support for overflowing_labels to slow tokenizer

NielsRogge committed 3 years ago

394ef1dd

Make fast tokenizer support overflowing boxes and labels

NielsRogge committed 3 years ago

0dcb5217

Make all tests pass for fast tokenizer

NielsRogge committed 3 years ago

4e533289

Make more tests pass

NielsRogge committed 3 years ago

739011ac

Mkae more tests pass

NielsRogge committed 3 years ago

a3a6b594

Addd padding to fast tokenizer

NielsRogge committed 3 years ago

474ac976

More improvements

NielsRogge committed 3 years ago

20181639

Make more tests pass

NielsRogge committed 3 years ago

0755e239

Make more tests pass

NielsRogge committed 3 years ago

b5fe312b

Enable fast tokenizer tests

NielsRogge committed 3 years ago

9050ce71

More improvements

NielsRogge committed 3 years ago

b0741bcd

First draft of fast tokenizer

NielsRogge committed 3 years ago

d63a6314

Fix tokenizer test and make model tests smaller

NielsRogge committed 3 years ago

3fa1768d

Add durations to see which tests are slow

NielsRogge committed 3 years ago

34120654

Add pip install torchvision

NielsRogge committed 3 years ago

4037cf10

Comment out non-detectron2 jobs and specify number of processes

NielsRogge committed 3 years ago

2d972505

Simplify CI job

NielsRogge committed 3 years ago

27d3179d

Add detectron2 CI job

NielsRogge committed 3 years ago

feab66b1

Fix tokenizer test

NielsRogge committed 3 years ago

32bd570f

Fix failing tests and add suggestion from code review

NielsRogge committed 3 years ago

5b721700

Improve processor tests

NielsRogge committed 3 years ago

2d4b072e

Apply suggestions from code review

NielsRogge committed 3 years ago

bddff34e

Remove LayoutLMv2TokenizerFast from auto tokenization

NielsRogge committed 3 years ago

e1746eb9

Add truncation of labels

NielsRogge committed 3 years ago

a933bd8d

Add batched tests for LayoutLMv2Processor, remove fast tokenizer

NielsRogge committed 3 years ago

f11a8af9

Make quality and small docs improvements

NielsRogge committed 3 years ago

1b415f78

Improve documentation and one more tokenizer test

NielsRogge committed 3 years ago

21f87e4e

Improve feature extractor

NielsRogge committed 3 years ago

b6dd8224

Older