Implemented safetensors checkpoints save/load for Trainer #22498
implemented safetensors save/load
e17ae7c7
remove duplicated file
f5195a71
added tests
652b28e8
more tests
e46cbf43
style fix
58e8348a
fix tf tests
67ebed81
change to list comprehension
797b455e
review fixes + safe load for sharded checkpoint
3a3fdf0e
style fix
6b856f3f
remove rogue import
6062b54f
remove partial to avoid undefined exception
befac459
use naming alias instead of safetensors.torch
5f7fc5f0
fix safe sharding in tests
7bc07e3a
sgugger
approved these changes
on 2023-04-03
grammar
24de50bd
update docs
e4026bc3
update docs
516c8cba
minor corrections
8f9564ec
style
2a9d2218
sgugger
merged
871598be
into main 2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub