ddp+dynamo: assorted fixes
* fix requeue, so that when a job gets preempted, the job can be
resubmitted.
* add ADAM_CAPTURABLE to force using the capturable optimizer
* Assert that torch.version.debug == False, because debug=True is bad
for benchmarking and particularly bad for NCCL performance for some
reason.
ghstack-source-id: 24e2dbb4c0e2d1fe0d03b66b4e5c6e1411a04f1e
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1223
