DeepSpeed
add zero3 ```module_granularity_threshold ``` to zero optimization.
#6649
Merged
Overview
Commits
36
Changes
View On GitHub

add zero3 ```module_granularity_threshold ``` to zero optimization. #6649

loadams merged 36 commits into deepspeedai:master from inkcherry:z3_coalesced_fetch
inkcherry
inkcherry z3 coalesced fetch
a2610d8a
inkcherry fix format
4e8be085
inkcherry fix default value
76419945
inkcherry inkcherry requested a review from tjruwase tjruwase 1 year ago
inkcherry inkcherry requested a review from tohtana tohtana 1 year ago
inkcherry inkcherry requested a review from awan-10 awan-10 1 year ago
inkcherry fix default
805a8207
delock
delock Merge branch 'master' into z3_coalesced_fetch
ce7dfb7f
inkcherry fix ut
810353bb
inkcherry fix ut
a8dd8fe1
loadams Merge branch 'master' into z3_coalesced_fetch
53584cac
loadams
inkcherry
nelyahu
inkcherry
tjruwase Merge branch 'master' into z3_coalesced_fetch
4d86198f
tjruwase tjruwase removed review request from awan-10 awan-10 1 year ago
tjruwase
inkcherry
tjruwase
inkcherry add ut(usage)
7b94377b
inkcherry use int type config
cd31a0d1
inkcherry fix format
ea509645
inkcherry Merge remote-tracking branch 'origin/z3_coalesced_fetch' into z3_coal…
b0681189
inkcherry inkcherry requested a review from loadams loadams 1 year ago
inkcherry fix note
600d9c74
inkcherry
tjruwase Merge branch 'master' into z3_coalesced_fetch
4477077e
inkcherry refine code
c2c434bd
inkcherry remove debug code
e5f9430c
inkcherry update
c2b020a4
inkcherry Merge remote-tracking branch 'origin/z3_coalesced_fetch' into z3_coal…
511ace01
inkcherry don't set leaf for container module
36801098
inkcherry Merge branch 'master' into z3_coalesced_fetch
f2752f82
tjruwase
tjruwase commented on 2024-11-05
tjruwase
tjruwase commented on 2024-11-05
tjruwase
tjruwase commented on 2024-11-05
tjruwase
tjruwase commented on 2024-11-05
inkcherry update ut
22c0f81c
inkcherry udpate
f7732580
inkcherry change config name, refine doc
c31ad023
inkcherry fix rjust size
40ceeac4
inkcherry fix merge
73e5bd54
inkcherry format
c31c8d21
inkcherry inkcherry changed the title add zero3 coalesced parameters fetch to zero optimization. add zero3 ```module_granularity_threshold ``` to zero optimization. 1 year ago
inkcherry always print info if the config is enabled
619cbe68
inkcherry Merge branch 'master' into z3_coalesced_fetch
3c0a1830
inkcherry update
a6e5a399
inkcherry Merge branch 'z3_coalesced_fetch' of https://github.com/inkcherry/Dee…
e7e5cdf3
tjruwase
tjruwase commented on 2024-11-09
inkcherry Merge remote-tracking branch 'upstream/master' into z3_coalesced_fetch
00ac4eb5
inkcherry use mark parametrize for test
25df9623
tjruwase
tjruwase approved these changes on 2024-11-11
tjruwase Merge branch 'master' into z3_coalesced_fetch
fdd6fbf2
tjruwase Merge branch 'master' into z3_coalesced_fetch
b8609611
delock Merge branch 'master' into z3_coalesced_fetch
dfb2b45b
loadams loadams merged 7af3a4be into master 1 year ago
skyshine102
inkcherry

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum