Transformer kernel/fix layer norm #1587
tjruwase
merged
18 commits into
master
from
transformer-kernel/fix-layer-norm
fixing the softmax masking when using triangular masking
f7ef4b5e
Merge branch 'master' of github.com:microsoft/DeepSpeed
dfb603fe
Merge branch 'master' of github.com:microsoft/DeepSpeed
c5ecf325
Merge branch 'master' of github.com:microsoft/DeepSpeed
426ecf73
Merge branch 'master' of github.com:microsoft/DeepSpeed
fde63105
Merge branch 'master' of github.com:microsoft/DeepSpeed
5bd5f2bb
Merge branch 'master' of github.com:microsoft/DeepSpeed
9691d5ef
Merge branch 'master' of github.com:microsoft/DeepSpeed
3460d201
fix a bug in the the layernorm backward kernels
8c927fda
Merge branch 'master' into transformer-kernel/fix-layer-norm
4c9ccc10
tjruwase
commented
on 2021-11-24
tjruwase
commented
on 2021-11-24
Merge branch 'master' into transformer-kernel/fix-layer-norm
c9b40572
revert back some changes & remove debug code
051d5667
Merge branch 'transformer-kernel/fix-layer-norm' of github.com:micros…
cfee6e13
tjruwase
commented
on 2021-11-24
tjruwase
approved these changes
on 2021-11-24
Merge branch 'master' into transformer-kernel/fix-layer-norm
c6a86fdd
change the constants to a macro
39211494
tjruwase
approved these changes
on 2021-11-29
Merge branch 'master' into transformer-kernel/fix-layer-norm
e939c57c
Merge branch 'master' into transformer-kernel/fix-layer-norm
3abe6dde
Merge branch 'master' into transformer-kernel/fix-layer-norm
94d02863
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub