CPUAdam fp16 and bf16 support #5409
tjruwase
merged
37 commits into
deepspeedai:master
from
BacharL:hab_cpu_adam
BacharL
changed the title 
tjruwase
commented
on 2024-05-04
tjruwase
commented
on 2024-05-04
tjruwase
commented
on 2024-05-04
tjruwase
commented
on 2024-05-04
tjruwase
commented
on 2024-05-04
[SW-0] allow running tests on simulator
65faa95d
fused adam for hpu
f18eef35
CPUAdam fp16 and bf16 support
c3899714
add missing functions
04a95e53
remvoe set_dtype function, move dtype argument to constructor
46138042
fix dead code
4f13b2e6
cleanup half_precision
fd9901d8
remove HALF_DTYPE compiler define
9b3151db
apply changes to cpulion and cpuadagrad
f940312d
fix compile errors
beb0d6cd
fix compile errors
f7ee43cf
pre commit
d8efc503
tjruwase
commented
on 2024-05-06
codepsell fixes
a5a0531f
fix typo
42cbf955
Merge branch 'master' into hab_cpu_adam
aaeffe69
RezaYazdaniAminabadi
commented
on 2024-05-07
cpu adam templated param,state and device types
d9d21883
fix cuda build
4d150cf9
pre commit
930ca333
apply changes to adagrad and lion
468a314f
pre commit
2987e5fa
fix typos
3c86804a
tjruwase
commented
on 2024-05-08
Merge branch 'master' into hab_cpu_adam
cebcd21e
Revert "fused adam for hpu"
a690a0df
cleanup device params and cuda specific code from cpuadam
f518a701
cleanup cuda code from cpulion and cpuadagrad
79477f37
fix builders
023d1f85
pre commit
005c7cc8
fix builders
9b115590
fix cpulion build
48ac1297
remove unused function declerations
abc5b2bd
Merge branch 'master' into hab_cpu_adam
6bd525ad
fix bf16 to numpy conversion in tests
8aa6a204
BacharL
commented
on 2024-05-12
Merge branch 'master' into hab_cpu_adam
cbef0bfb
skip test_torch_adamw_equal for invalid parameter combinations
23625cfe
remove fp16_param_groups argument
e8e1b251
pre commit
0f5ffc3d
Merge branch 'master' into hab_cpu_adam
62975f28
tjruwase
approved these changes
on 2024-05-20
Login to write a write a comment.
Login via GitHub