accelerate
Add `join_uneven_inputs` context manager to Accelerator
#820
Merged

Add `join_uneven_inputs` context manager to Accelerator #820

muellerzr merged 19 commits into huggingface:main from ch/join_context_manager
Chris-hughes10
Chris-hughes10 Add test for join context manager
80420e52
Chris-hughes10 Add join_uneven_inputs context manager
71aa7df8
Chris-hughes10 Format
bc4d6ac1
HuggingFaceDocBuilderDev
Chris-hughes10 add conditional import for join
02a89e30
Chris-hughes10
Chris-hughes10 Replace bare yield with nullcontext
dc028e6f
muellerzr
sgugger
sgugger commented on 2022-11-04
muellerzr
pacman100
pacman100 commented on 2022-11-07
Chris-hughes10
pacman100
muellerzr
sgugger
Chris-hughes10 Update accelerator to maintain references to dataloaders
bff03f4b
Chris-hughes10 add override option to join context manager
87f2db6a
Chris-hughes10 format
3da680c7
Chris-hughes10
muellerzr
Chris-hughes10 Add minimal docstring
124057ca
sgugger
sgugger commented on 2022-11-07
Chris-hughes10 updates based on initial feedback
05543103
Chris-hughes10 remove launcher used for local testing from test script
54f690a6
Chris-hughes10 fix quality issues
129153b5
Chris-hughes10 Merge branch 'main' into ch/join_context_manager
9c60f67c
Chris-hughes10 DEBUG: try resetting accelerator state to fix test
a13a56ea
Chris-hughes10 Revert "DEBUG: try resetting accelerator state to fix test"
e6acb1c1
Chris-hughes10
muellerzr
pacman100
Chris-hughes10
Chris-hughes10 Reset state after accelerator tests
93521577
HuggingFaceDocBuilderDev
sgugger
sgugger approved these changes on 2022-11-10
muellerzr
muellerzr approved these changes on 2022-11-10
Chris-hughes10 Update src/accelerate/accelerator.py
f26b9ca9
Chris-hughes10 Warn if at least one iterable dataset seen
71341c43
Chris-hughes10 remove launcher used for local test running
bd391ada
Chris-hughes10
muellerzr
Chris-hughes10 Chris-hughes10 changed the title [WIP] Add `join_uneven_inputs` context manager to Accelerator Add `join_uneven_inputs` context manager to Accelerator 3 years ago
muellerzr muellerzr merged 074d8d5a into main 3 years ago
muellerzr
Chris-hughes10 Chris-hughes10 deleted the ch/join_context_manager branch 3 years ago
Chris-hughes10
HuggingFaceDocBuilderDev

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone