transformers

384f0eb2 - Map optimizer to correct device after loading from checkpoint. (#4403)

Map optimizer to correct device after loading from checkpoint. (#4403) * Map optimizer to correct device after loading from checkpoint. * Make style test pass Co-authored-by: Julien Chaumond <chaumond@gmail.com>