PR #147 support calibration dataset concat

support calibration dataset concat #147

wenhuach21 merged 11 commits into main from lyt/catpad

update code

1746fd77

update

4513346f

update

38e195d4

merge main

b5fcdf41

enable num and split param

9b605b4b

enable different types of local dataset

012ccbc3

fix some corner issues of target_cnt

8d3448c4

modify readme

0975c5dd

remove bos eos when concating

89b685ee

wenhuach21 approved these changes on 2024-06-17

doc refinement

47041edb

wenhuach21 commented on 2024-06-17

update readme

b466ca5a

wenhuach21 merged 75e3fde0 into main 2 years ago

wenhuach21 deleted the lyt/catpad branch 2 years ago

Reviewers

wenhuach21

Assignees

No one assigned

Labels

None yet

Milestone

No milestone