transformers
Fix Mega chunking error when using decoder-only model
#25765

Merged

Fix Mega chunking error when using decoder-only model #25765

ArthurZucker merged 3 commits into huggingface:main from tanaymeh:fix_mega_chunking_errors

tanaymeh changed the title ~~Fix Mega chunking error when using decoder-only model.~~ Fix Mega chunking error when using decoder-only model 2 years ago

tanaymeh marked this pull request as ready for review 2 years ago

ArthurZucker commented on 2023-08-28

ArthurZucker approved these changes on 2023-09-04

add: potential fix to mega chunking in decoder only model bug

c4812a00

add: decoder with chunking test

6454539e

add: input_mask passed with input_ids

aa2ff482

tanaymeh force pushed to aa2ff482 2 years ago

ArthurZucker merged b8def689 into main 2 years ago

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Fix Mega chunking error when using decoder-only model #25765 Merged

Fix Mega chunking error when using decoder-only model #25765

transformers
Fix Mega chunking error when using decoder-only model
#25765

Merged