pytorch
dbbe0a21 - [DataLoader] Introduce deterministic context (#53271)

Commit
3 years ago
[DataLoader] Introduce deterministic context (#53271) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/53271 - [x] Add `set_determinism` context manager - [x] Add `non_deterministic` decorator for `DataPipe` - Raise error at the construction time for non-deterministic DataPipe when `determinism` is set to `True` - [ ] Support `non_deterministic` with option - When `GreedyJoin` only contains one datapipe, it should still be deterministic. Note: Test is in the [PR](https://github.com/facebookexternal/torchdata/pull/15). As the main repo doesn't have non-deterministic DataPipe yet. Test Plan: Imported from OSS Reviewed By: anjali411 Differential Revision: D26823023 Pulled By: ejguan fbshipit-source-id: 51bb92fc3d18d1fc9536c1229363c536ad120876
Author
Parents
Loading