DeepSpeed
Add purely-local sliding window sparse attention config
#1962
Merged
Overview
Commits
6
Changes
View On GitHub

Add purely-local sliding window sparse attention config #1962

jeffra merged 6 commits into master from qanthony/window-sa
Quentin-Anthony
Quentin-Anthony Add purely-local sliding window sparse attention config
0d90683e
Quentin-Anthony Added import and some fixes for purely-local SA config
9f8ff68e
Quentin-Anthony Quentin-Anthony requested a review from jeffra jeffra 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from samyam samyam 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from tjruwase tjruwase 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from ShadenSmith ShadenSmith 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from conglongli conglongli 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from awan-10 awan-10 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from cli99 cli99 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from eltonzheng eltonzheng 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from minjiaz minjiaz 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
tjruwase Merge branch 'master' into qanthony/window-sa
2b2fbcfa
rocm-mici
Quentin-Anthony Merge branch 'master' into qanthony/window-sa
8bf736ca
Quentin-Anthony Merge branch 'master' into qanthony/window-sa
c7d2a7f3
Quentin-Anthony Quentin-Anthony requested a review from duli2012 duli2012 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from mrwyattii mrwyattii 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from yaozhewei yaozhewei 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from arashb arashb 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
jeffra Merge branch 'master' into qanthony/window-sa
d67b1958
jeffra jeffra requested a review from samadejacobs samadejacobs 3 years ago
jeffra
jeffra approved these changes on 2022-07-27
jeffra jeffra merged be46ff6d into master 3 years ago
jeffra jeffra deleted the qanthony/window-sa branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum