Optimize fs2 preprocess by maximizing parallelization benefits #40
roedoejet
merged
10 commits into
main
from
dev.optimize-preprocess
perf: use joblib.Parallel instead of pathos.multiprocessing for faste…
43b78096
refactor: make function process_one_audio in prep for parallelization
ceb09436
perf: parallelize audio processing too
7f9ee378
ci: fix CI by using pytorch==2.0.1 and torchaudio==2.0.2 explicitly
39d24d60
fix: make counters compatible with multi-processing
b13148a3
style: make torch and rich package use explicit
5ab0e21e
fix(tests): failing tests is an error, fix dataloader tests to pass
a85d2ce0
perf: gather stats in parallel too, plus some style improvements
cbbd5d42
Base automatically changed from
dev.cli-config-for-arrays
to
main
1 year ago
fix(deps): remove pathos dependency, no longer used
2e59982b
ci: fix the installation of torch and friends
b66f38de
Login to write a write a comment.
Login via GitHub