accelerate
074d8d5a - Add `join_uneven_inputs` context manager to Accelerator (#820)

Commit
3 years ago
Add `join_uneven_inputs` context manager to Accelerator (#820) * Add test for join context manager * Add join_uneven_inputs context manager * Format * add conditional import for join * Replace bare yield with nullcontext * Update accelerator to maintain references to dataloaders * add override option to join context manager * format * Add minimal docstring * updates based on initial feedback * remove launcher used for local testing from test script * fix quality issues * DEBUG: try resetting accelerator state to fix test * Revert "DEBUG: try resetting accelerator state to fix test" This reverts commit a13a56ea8e084cad72317cd451a176a2d3fa5dff. * Reset state after accelerator tests * Update src/accelerate/accelerator.py Co-authored-by: Zachary Mueller <muellerzr@gmail.com> * Warn if at least one iterable dataset seen * remove launcher used for local test running Co-authored-by: Zachary Mueller <muellerzr@gmail.com>
Parents
Loading