DeepSpeed
Fix transformer kernel CUDA illegal memory access error
#765

Merged

Fix transformer kernel CUDA illegal memory access error #765

conglongli merged 1 commit into master from conglli/kernel-patch

need to create a new options to avoid CUDA illegal access error

7c1eeb85

conglongli requested a review from

RezaYazdaniAminabadi 4 years ago

conglongli requested a review from

arashashari 4 years ago

conglongli requested a review from

awan-10 4 years ago

conglongli requested a review from

cli99 4 years ago

conglongli requested a review from

eltonzheng 4 years ago

conglongli requested a review from

jeffra 4 years ago

conglongli requested a review from

minjiaz 4 years ago

conglongli requested a review from

niumanar 4 years ago

conglongli requested a review from

samyam 4 years ago

conglongli requested a review from

ShadenSmith 4 years ago

conglongli requested a review from

tjruwase 4 years ago

conglongli changed the title ~~Fix transformer kernel to avoid CUDA illegal memory access error when validation is enabled~~ Fix transformer kernel CUDA illegal memory access error 4 years ago

RezaYazdaniAminabadi approved these changes on 2021-02-18

conglongli merged 1fcc5f7a into master 4 years ago

conglongli deleted the conglli/kernel-patch branch 4 years ago

Reviewers

RezaYazdaniAminabadi

arashashari

awan-10

cli99

eltonzheng

jeffra

minjiaz

niumanar

samyam

ShadenSmith

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Fix transformer kernel CUDA illegal memory access error #765 Merged

Fix transformer kernel CUDA illegal memory access error #765

DeepSpeed
Fix transformer kernel CUDA illegal memory access error
#765

Merged