transformers

Fix bug for checkpoint saving on multi node training setting

#28078

Merged