transformers
[saving] Simplify general logic
#42766
Merged
Overview
Commits
9
Changes
View On GitHub

[saving] Simplify general logic #42766

Cyrilvallez merged 9 commits into main from parallel-saving
Cyrilvallez
Cyrilvallez parallelize and cleanup
86ef6bd4
HuggingFaceDocBuilderDev
Cyrilvallez simplify offloading
5acf6b76
Cyrilvallez fix
a15f2262
Cyrilvallez oupsi
41cf6d21
Cyrilvallez add env variable to deactivate
67e29e58
Cyrilvallez revert threading -> safetensors does not release the GIL
236a0733
Cyrilvallez comment
4d2ddf93
Cyrilvallez create helper
24230ddf
Cyrilvallez move it to accelerate integration
4bd1b20e
Cyrilvallez Cyrilvallez changed the title [saving] Parallelize shard writing, and simplify general logic [saving] Simplify general logic 126 days ago
github-actions
ArthurZucker
ArthurZucker approved these changes on 2025-12-12
Cyrilvallez Cyrilvallez merged e6b9d061 into main 124 days ago
Cyrilvallez Cyrilvallez deleted the parallel-saving branch 124 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum