DeepSpeed
supporting different hidden dimensions
#559
Merged
Overview
Commits
9
Changes
View On GitHub

supporting different hidden dimensions #559

RezaYazdaniAminabadi merged 9 commits into master from transformer-kernel/arbitrary-hidden-dimension
RezaYazdaniAminabadi
supporting different hidden dimensions
de20c4c9
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samyam samyam 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from eltonzheng eltonzheng 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from arashashari arashashari 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cli99 cli99 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from conglongli conglongli 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from minjiaz minjiaz 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from niumanar niumanar 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from ShadenSmith ShadenSmith 5 years ago
jeffra
jeffra commented on 2020-11-25
jeffra Merge branch 'master' into transformer-kernel/arbitrary-hidden-dimension
98764b9e
tjruwase
tjruwase approved these changes on 2020-11-25
jeffra Merge branch 'master' into transformer-kernel/arbitrary-hidden-dimension
0443a55e
jeffra
jeffra requested changes on 2020-11-25
RezaYazdaniAminabadi
add support for larger hidden dimensions (greater than 8K)
733927d4
Merge branch 'transformer-kernel/arbitrary-hidden-dimension' of githu…
539f2e3f
remove empty line
86c77353
add loop unrolling factor for dropout kernels
d50fbb4d
samyam
samyam commented on 2020-11-30
samyam
samyam commented on 2020-11-30
eltonzheng
eltonzheng commented on 2020-11-30
eltonzheng
eltonzheng approved these changes on 2020-12-01
update different kernels based on the reviews
f3dd328d
jeffra Merge branch 'master' into transformer-kernel/arbitrary-hidden-dimension
21dd505b
jeffra
jeffra approved these changes on 2020-12-01
RezaYazdaniAminabadi RezaYazdaniAminabadi merged c78c29f9 into master 5 years ago
mrwyattii mrwyattii deleted the transformer-kernel/arbitrary-hidden-dimension branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum