DeepSpeed
Samyamr/inference hook fix
#851
Merged

Samyamr/inference hook fix #851

samyam merged 13 commits into master from samyamr/inference-hook-fix
samyam
samyam Fix mis-aligned-grad
2ffaecbb
Merge branch 'master' into fix-misaligned-grad
a55a8dd4
samyam Formatting fix
ac9266ee
samyam Adding static_scale test back for Z3, and also changing hidden size t…
bf53561c
samyam also removing alignment from flat fp16 buffers
9cd813d2
samyam Testing for hidden dim alignment
5692c62b
samyam samyam requested a review from arashashari arashashari 4 years ago
samyam samyam requested a review from awan-10 awan-10 4 years ago
samyam samyam requested a review from cli99 cli99 4 years ago
samyam samyam requested a review from conglongli conglongli 4 years ago
samyam samyam requested a review from eltonzheng eltonzheng 4 years ago
samyam samyam requested a review from jeffra jeffra 4 years ago
samyam samyam requested a review from minjiaz minjiaz 4 years ago
samyam samyam requested a review from niumanar niumanar 4 years ago
samyam samyam requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
samyam samyam requested a review from ShadenSmith ShadenSmith 4 years ago
samyam samyam requested a review from tjruwase tjruwase 4 years ago
samyam inference hook fix
f8881306
stas00
tjruwase
tjruwase approved these changes on 2021-03-11
samyam Update stage3.py
06a75680
stas00
jeffra formatting
e1122046
jeffra Merge branch 'master' into samyamr/inference-hook-fix
c831a9c9
jeffra Merge branch 'master' into samyamr/inference-hook-fix
58969d14
jeffra [bug-fix] move params to gpu if offload params is turned off
d4ef4ff0
stas00
stas00
jeffra Merge branch 'master' into samyamr/inference-hook-fix
0d165452
samyam samyam merged 46018859 into master 4 years ago
samyam samyam deleted the samyamr/inference-hook-fix branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone