SPLIT PR: eos bos tokens #31316
itazap
wants to merge
31 commits into
main
from
bos_eos_token_fix
ArthurZucker
approved these changes
on 2024-08-22
itazap
commented
on 2024-08-22
add missing import
200c1ccb
add condition for update
d77e5ea7
skip if post_processor is not type Sequence (do not support TemplateP…
a76d2b74
rebased missed
154979ce
clean after rebase
cca19dd1
CI make copies issue fix?
2dbb00ce
Adding bos eos test
c490db21
undo pegasus change
0a150609
undo pegasus change
46d11535
clean up spaces for pr
39d92e77
clean up for PR
ef0bd27e
rebase
e8bfe905
cleaning after rebase
f80a9fd4
add conidition for updating post processor
dbacd660
revert comment
c7a84ff4
make test asserts consistent
92b52ce1
update with warning
832ecb57
update test
0d8e00e3
logger.warn
040e2fef
autodoc for bos/eos token
04608b0a
update docstring as per feedback
2df45da0
Trigger CI attempt
89fde69d
missed rebase commit
6102d5d3
use internal repo for tesT
40a05d09
use internal repo for test
b9576581
use internal repo for test
6312dd33
Merge branch 'main' into bos_eos_token_fix
aad810db
ruff
0d3085db
test reload saved
1fb5b16a
test reload saved
a1e024e1
Merge branch 'main' into bos_eos_token_fix
02e75eb3
Reviewers
Assignees
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub