DeepSpeed
add fp32-fp16 casting kernel
#369
Merged
Overview
Commits
11
Changes
View On GitHub

add fp32-fp16 casting kernel #369

RezaYazdaniAminabadi merged 11 commits into staging-zero-dual-v3 from reza/deepspeed_adam_merge_v3
RezaYazdaniAminabadi
fixing adam copy fp16-param-add more compile flags for cpu_adam
1d4b41fe
run precommit
59ffc1a9
fix variance indexes
ad8af384
fix array-sizes
2d17a6d3
move adam_test
37887241
rename perf test
36d5fde7
add casting kernel
bb75df77
run precommit
7aaccf45
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from arashashari arashashari 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cli99 cli99 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from conglongli conglongli 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from eltonzheng eltonzheng 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from minjiaz minjiaz 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from niumanar niumanar 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samyam samyam 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from ShadenSmith ShadenSmith 5 years ago
revert changes
d4c3b0a9
revert changes
4c257dd0
Merge branch 'staging-zero-dual-v3' into reza/deepspeed_adam_merge_v3
58c0741f
RezaYazdaniAminabadi RezaYazdaniAminabadi merged 773e454c into staging-zero-dual-v3 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum