transformers
LayoutLMv2Processor: ensure 1-to-1 mapping between images and samples in case of overflowing tokens
#17092
Merged

LayoutLMv2Processor: ensure 1-to-1 mapping between images and samples in case of overflowing tokens #17092

sgugger merged 4 commits into huggingface:main from garyhlai:main
garyhlai
garyhlai add get_overflowing_images function to ensure 1-to-1 mapping between …
1111e760
HuggingFaceDocBuilderDev
garyhlai make style
212e032f
sgugger
sgugger approved these changes on 2022-05-05
NielsRogge
NielsRogge approved these changes on 2022-05-05
sgugger
sgugger commented on 2022-05-06
garyhlai add test for overflowing_tokens, change assert to ValueError, avoidin…
65746446
garyhlai garyhlai force pushed to 65746446 3 years ago
garyhlai change line length by passing --preview into black
330c8b83
sgugger sgugger merged e9fd583c into main 3 years ago
sgugger
timothyjlaurent

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone