DeepSpeed
Fp32 accuracy bug fix
#2285
Merged
Overview
Commits
7
Changes
View On GitHub

Fp32 accuracy bug fix #2285

jeffra merged 7 commits into master from ds-inference/opt-FP32-accuracy-fix
RezaYazdaniAminabadi
Fix the tensor-slicing copy for qkv parameters
920e6be2
Merge branch 'master' of github.com:microsoft/DeepSpeed
cd0ea266
Merge branch 'master' of github.com:microsoft/DeepSpeed
d067773e
Merge branch 'master' of github.com:microsoft/DeepSpeed
bdff8bf9
fixing the softmax mask offset on the softmax-fp32 implementation
89549229
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samyam samyam 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from ShadenSmith ShadenSmith 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from conglongli conglongli 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cli99 cli99 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from eltonzheng eltonzheng 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from minjiaz minjiaz 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from duli2012 duli2012 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from mrwyattii mrwyattii 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from yaozhewei yaozhewei 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from arashb arashb 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samadejacobs samadejacobs 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cmikeh2 cmikeh2 3 years ago
arashb encapsulate mask stride obtaining logic in separate functions
1d7d1ebf
arashb Merge branch 'master' into ds-inference/opt-FP32-accuracy-fix
32c1df39
jeffra
jeffra approved these changes on 2022-09-03
jeffra jeffra merged 47e030f5 into master 3 years ago
jeffra jeffra deleted the ds-inference/opt-FP32-accuracy-fix branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum