datasets
Do not consume unnecessary memory during sharding
#7136
Open
Overview
Commits
1
Changes
View On GitHub

Do not consume unnecessary memory during sharding #7136

janEbert wants to merge 1 commit into huggingface:main from janEbert:fix-shard-oom
janEbert
janEbert Do not consume unnecessary memory during sharding
afeaa9af
janEbert janEbert force pushed from e90b8a7f to afeaa9af 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum