transformers
6ef7186b - fixed crash when deleting older checkpoint and a file f"{checkpoint_prefix}-*" exist (#16686)

Commit

3 years ago

fixed crash when deleting older checkpoint and a file f"{checkpoint_prefix}-*" exist (#16686) I create an archive of older checkpoints during training the checkpoint has a name with `f"{checkpoint_prefix}-*.zip/.tar ` previously `glob(f"{checkpoint_prefix}-*")` takes all files/folders starting with the name checkpoint, and later `shutil.rmtree(checkpoint)` takes a folder name; since at some point it my get a zip file; it crashes training; adding this `if os.path.isdir(x)` allows only folders on `glob_checkpoints`

References

#16686 - fixed crash when deleting older checkpoint and files with name f"{checkpoint_prefix}-*" exist

#19449 - [WIP] Fix weights initialization of several vision models

#27720 - Add common processor tests

#29969 - [SigLIP] Add fast tokenizer

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

Author

sadransh

Parents

b0bf3011

transformers 6ef7186b - fixed crash when deleting older checkpoint and a file f"{checkpoint_prefix}-*" exist (#16686)

transformers
6ef7186b - fixed crash when deleting older checkpoint and a file f"{checkpoint_prefix}-*" exist (#16686)