Sparse attn triton v1.0 support + torch1.8 test runner #1374
jeffra
merged
23 commits into
master
from
reyazda/test-sparse-v2
let the sparse tests run
18a8dffe
fixing the sparse-APIs to use the latest triton version
80dbe2f7
update with assert and some fixes
be55c85c
add torch18 tests and fix sparse-attn checks
9e2dee4b
turn back on tests
e7028669
use relative paths for megatron jsons
54752d0e
factor out relative path for unit test files
741f8b55
set test path
626a51e4
refactor sparse attn imports
318ae956
Merge branch 'master' into reyazda/test-sparse-v2
99634357
fix relative import
49514bd3
rename test_path so pytest doesn't think its a test
61bf986e
skip test_configurable_parallel for now until fixed
35245fef
moe fix
0d28040f
fixes random connection reset test failures for some unit tests
d1615ff0
resolve the TK with correct setting based on dtype and block size
940abc6c
Merge branch 'reyazda/test-sparse-v2' of github.com:microsoft/DeepSpe…
bd13efde
fix megatron regression, add moe unit test, fix moe ckpt comparison
7d9c5fb1
add sparse-attn skip if not compatible
7733f00d
Merge branch 'master' into reyazda/test-sparse-v2
80011245
skip moe ckpt test if old torch
08695e29
turn back on test_configurable_parallel
1324589e
tear down torch dist pg when test completes
3beb9fd9
tjruwase
approved these changes
on 2021-09-21
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub