accelerate

05534836 - Fix Wrong use of sync_gradients used to implement sync_each_batch (#2790)

Fix Wrong use of sync_gradients used to implement sync_each_batch (#2790) * fix wrong use of sync_gradients to implement sync_each_batch as pointed out by @Nightmare-n Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com> * fix test --------- Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>