accelerate
feat: use datasets.IterableDataset shard if possible.
#3583

Closed

feat: use datasets.IterableDataset shard if possible. #3583

ValMystletainn wants to merge 1 commit into huggingface:main from ValMystletainn:feat/datasets_iterable_shard

feat: use datasets.IterableDataset shard if possible.

d1f0acef

SunMarc commented on 2025-05-22

SunMarc closed this 189 days ago

ValMystletainn deleted the feat/datasets_iterable_shard branch 141 days ago

Reviewers

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone