transformers

7f34d757 - [s2s trainer] fix DP mode (#8823)

[s2s trainer] fix DP mode (#8823) * fix DP case on multi-gpu * make executable * test all 3 modes * use the correct check for distributed * dp doesn't need a special case * restore original name * cleanup