[WIP] Enable reproducibility for distributed trainings #16907
sgugger
merged
10 commits into
huggingface:main
from
hasansalimkanmaz:enable-reproducibility-during-distributed-training
add seed worker and set_deterministic_seed_for_cuda function to enfor…
87ac401e
change function name to enable determinism, add docstrings, reproduca…
df538119
change function name to enable_determinism_for_distributed_training
041d20d3
sgugger
approved these changes
on 2022-04-25
LysandreJik
commented
on 2022-04-25
revert changes in set_seed and call set_seed within enable_full_deter…
77e8308b
Merge remote-tracking branch 'upstream/main' into enable-reproducibil…
2e40858e
add one position argument for seed_worker function
7ee6c681
add full_determinism flag in training args and call enable_full_deter…
43b3669f
add enable_full_determinism to documentation
3c1e31ac
apply make fixup after the last commit
f8f89269
sgugger
approved these changes
on 2022-05-11
Update src/transformers/training_args.py
1066995c
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub