DeepSpeed
Fix softmax backward
#2709
Merged
Overview
Commits
6
Changes
View On GitHub

Fix softmax backward #2709

tjruwase merged 6 commits into master from fix-softmax-backward
RezaYazdaniAminabadi
Reset KV-cache at the beginning of text-generation
8e91537e
Merge branch 'master' of github.com:microsoft/DeepSpeed
963cc9a5
Add new backward kernel to handle large softmax-length
f6953509
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from mrwyattii mrwyattii 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cmikeh2 cmikeh2 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from arashb arashb 3 years ago
remove unrelated changes
7b16d333
tjruwase Merge branch 'master' into fix-softmax-backward
94d556c9
cmikeh2
cmikeh2 commented on 2023-01-26
cmikeh2
cmikeh2 approved these changes on 2023-01-26
cmikeh2 Merge branch 'master' into fix-softmax-backward
05e13377
tjruwase tjruwase merged 0b06e0cb into master 3 years ago
mrwyattii mrwyattii deleted the fix-softmax-backward branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum