DeepSpeed
Fix potential random layout inconsistency issues in sparse attention modules
#534

Merged

Fix potential random layout inconsistency issues in sparse attention modules #534

arashashari merged 7 commits into deepspeedai:master from Justin1904:master

1) Register layout as buffer of module so that we can save/load check…

fb28742b

Justin1904 requested a review from

arashashari 5 years ago

Justin1904 requested a review from

awan-10 5 years ago

Justin1904 requested a review from

cli99 5 years ago

Justin1904 requested a review from

conglongli 5 years ago

Justin1904 requested a review from

eltonzheng 5 years ago

Justin1904 requested a review from

jeffra 5 years ago

Justin1904 requested a review from

minjiaz 5 years ago

Justin1904 requested a review from

niumanar 5 years ago

Justin1904 requested a review from

RezaYazdaniAminabadi 5 years ago

Justin1904 requested a review from

samyam 5 years ago

Justin1904 requested a review from

ShadenSmith 5 years ago

Justin1904 requested a review from

tjruwase 5 years ago

arashashari commented on 2020-11-18

arashashari approved these changes on 2020-11-18

Add docstring for max_seq_length argument in SparseSelfAttention

2509bad0

jeffra commented on 2020-11-18

Merge branch 'master' into master

2a3e0a8f

Merge branch 'master' into master

e087d99f

Merge branch 'master' into master

da2dd1e0

Merge branch 'master' into master

fbdf2bfc

Merge branch 'master' into master

8bed4178

arashashari merged 1e44d48d into master 5 years ago

Reviewers

arashashari

jeffra

ShadenSmith

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Fix potential random layout inconsistency issues in sparse attention modules #534 Merged

Fix potential random layout inconsistency issues in sparse attention modules #534

DeepSpeed
Fix potential random layout inconsistency issues in sparse attention modules
#534

Merged