DeepSpeed
Transformer kernel - fix unit test
#1503
Merged
Overview
Commits
12
Changes
View On GitHub

Transformer kernel - fix unit test #1503

jeffra merged 12 commits into master from transformer-kernel/fix-unit-test
RezaYazdaniAminabadi
fixing the softmax masking when using triangular masking
f7ef4b5e
fixing the transformer APIs to return tuple as needed as the output
fd1c182e
fix the post-layernorm backward test with loss-scaling
8da6689a
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cli99 cli99 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from conglongli conglongli 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from eltonzheng eltonzheng 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from minjiaz minjiaz 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from niumanar niumanar 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samyam samyam 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from ShadenSmith ShadenSmith 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 4 years ago
jeffra
jeffra approved these changes on 2021-10-29
jeffra Merge branch 'master' into transformer-kernel/fix-unit-test
a8865843
jeffra jeffra enabled auto-merge (squash) 4 years ago
remove changes from other PRs
563f5ea2
Merge branch 'transformer-kernel/fix-unit-test' of github.com:microso…
5df97ae7
jeffra Merge branch 'master' into transformer-kernel/fix-unit-test
bcd78d87
remove changes from other PRs
8eb3b04b
Merge branch 'transformer-kernel/fix-unit-test' of github.com:microso…
81ee120a
RezaYazdaniAminabadi Merge branch 'master' into transformer-kernel/fix-unit-test
e71ef714
jeffra Merge branch 'master' into transformer-kernel/fix-unit-test
671b03f2
jeffra Merge branch 'master' into transformer-kernel/fix-unit-test
aba8e6f9
jeffra jeffra merged 2c5bba6d into master 4 years ago
mrwyattii mrwyattii deleted the transformer-kernel/fix-unit-test branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum