DeepSpeed
Fix cudaErrorInvalidConfiguration in attn_softmax() for large values of sequence_length*num_heads
#1239
Merged
Overview
Commits
4
Changes
View On GitHub

Fix cudaErrorInvalidConfiguration in attn_softmax() for large values of sequence_length*num_heads #1239

RezaYazdaniAminabadi merged 4 commits into deepspeedai:master from dfyz:master
dfyz
Fix cudaErrorInvalidConfiguration in attn_softmax() for large seq_len…
bdc20422
dfyz dfyz requested a review from awan-10 awan-10 5 years ago
dfyz dfyz requested a review from cli99 cli99 5 years ago
dfyz dfyz requested a review from conglongli conglongli 5 years ago
dfyz dfyz requested a review from eltonzheng eltonzheng 5 years ago
dfyz dfyz requested a review from jeffra jeffra 5 years ago
dfyz dfyz requested a review from minjiaz minjiaz 5 years ago
dfyz dfyz requested a review from niumanar niumanar 5 years ago
dfyz dfyz requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
dfyz dfyz requested a review from samyam samyam 5 years ago
dfyz dfyz requested a review from ShadenSmith ShadenSmith 5 years ago
dfyz dfyz requested a review from tjruwase tjruwase 5 years ago
ghost
RezaYazdaniAminabadi Merge branch 'master' into master
a0f53586
RezaYazdaniAminabadi
RezaYazdaniAminabadi
RezaYazdaniAminabadi approved these changes on 2021-07-28
RezaYazdaniAminabadi Merge branch 'master' into master
23050b2b
RezaYazdaniAminabadi Merge branch 'master' into master
163b3926
RezaYazdaniAminabadi RezaYazdaniAminabadi merged bfe7f0db into master 5 years ago
dfyz

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum