accelerate
feat: use datasets.IterableDataset shard if possible
#3635
Merged

feat: use datasets.IterableDataset shard if possible #3635

SunMarc merged 4 commits into main from iter
SunMarc
ValMystletainn feat: use datasets.IterableDataset shard if possible.
d1f0acef
SunMarc dataset
ebceea41
SunMarc remove unused import
0b8fdbf6
SunMarc style
ddc8386f
HuggingFaceDocBuilderDev
SunMarc SunMarc merged 9888c7ed into main 259 days ago
SunMarc SunMarc deleted the iter branch 259 days ago
TonyCongqianWang
SunMarc

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone