transformers

daf281f4 - Enforce saving at end of training if saving option chosen (#30160)

Enforce saving at end of training if saving option chosen (#30160) * Enforce saving at end of training * Fix test * Rework test * Fixup tests' * Update comment based on sourab feedback * Clean