DeepSpeed
bcdfe3d0 - Enable async I/O tests with DS_DISABLE_REUSE_DIST_ENV

Commit
23 days ago
Enable async I/O tests with DS_DISABLE_REUSE_DIST_ENV - Add DS_DISABLE_REUSE_DIST_ENV environment variable check to tests/unit/common.py to allow disabling reuse_dist_env at runtime - This prevents pool worker cleanup hangs that occur when distributed environment is initialized in reused pool workers - Update aws-torch-latest.yml and aws-torch-latest-full.yml: - Mount /mnt/aio for O_DIRECT support (async I/O tests) - Set DS_DISABLE_REUSE_DIST_ENV=1 - Add --basetemp=/mnt/aio to pytest commands - Remove --ignore=unit/ops/aio (aio tests now enabled) Signed-off-by: Masahiro Tanaka <mtanaka@anyscale.com>
Author
Parents
Loading