transformers
Implemented safetensors checkpoints save/load for Trainer
#22498
Merged

Implemented safetensors checkpoints save/load for Trainer #22498

sgugger merged 18 commits into huggingface:main from safetensors_checkpointing
viktor-shcherb
viktor-shcherb implemented safetensors save/load
e17ae7c7
viktor-shcherb remove duplicated file
f5195a71
HuggingFaceDocBuilderDev
viktor-shcherb added tests
652b28e8
viktor-shcherb more tests
e46cbf43
viktor-shcherb style fix
58e8348a
viktor-shcherb fix tf tests
67ebed81
viktor-shcherb
sgugger
sgugger commented on 2023-03-31
viktor-shcherb change to list comprehension
797b455e
viktor-shcherb review fixes + safe load for sharded checkpoint
3a3fdf0e
viktor-shcherb style fix
6b856f3f
viktor-shcherb remove rogue import
6062b54f
viktor-shcherb remove partial to avoid undefined exception
befac459
viktor-shcherb use naming alias instead of safetensors.torch
5f7fc5f0
viktor-shcherb fix safe sharding in tests
7bc07e3a
viktor-shcherb
sgugger
sgugger approved these changes on 2023-04-03
viktor-shcherb grammar
24de50bd
viktor-shcherb update docs
e4026bc3
viktor-shcherb update docs
516c8cba
viktor-shcherb minor corrections
8f9564ec
viktor-shcherb style
2a9d2218
viktor-shcherb
sgugger sgugger merged 871598be into main 2 years ago
sgugger

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone