DeepSpeed
Reduce the device bubble introduced by heavy loop synchronization in coalesced fetch/release(z3_leaf_module)
#6694
Merged
Overview
Commits
48
Changes
View On GitHub

Reduce the device bubble introduced by heavy loop synchronization in coalesced fetch/release(z3_leaf_module) #6694

loadams merged 48 commits into deepspeedai:master from inkcherry:reduce_coalesced_fetch_bubble
inkcherry
inkcherry z3 coalesced fetch
a2610d8a
inkcherry fix format
4e8be085
inkcherry fix default value
76419945
inkcherry fix default
805a8207
delock Merge branch 'master' into z3_coalesced_fetch
ce7dfb7f
inkcherry fix ut
810353bb
inkcherry fix ut
a8dd8fe1
loadams Merge branch 'master' into z3_coalesced_fetch
53584cac
inkcherry inkcherry requested a review from tjruwase tjruwase 1 year ago
inkcherry inkcherry requested a review from tohtana tohtana 1 year ago
inkcherry inkcherry requested a review from awan-10 awan-10 1 year ago
tjruwase Merge branch 'master' into z3_coalesced_fetch
4d86198f
inkcherry add ut(usage)
7b94377b
inkcherry use int type config
cd31a0d1
inkcherry fix format
ea509645
inkcherry Merge remote-tracking branch 'origin/z3_coalesced_fetch' into z3_coal…
b0681189
inkcherry fix note
600d9c74
tjruwase Merge branch 'master' into z3_coalesced_fetch
4477077e
inkcherry refine code
c2c434bd
inkcherry remove debug code
e5f9430c
inkcherry update
c2b020a4
inkcherry Merge remote-tracking branch 'origin/z3_coalesced_fetch' into z3_coal…
511ace01
inkcherry don't set leaf for container module
36801098
inkcherry Merge branch 'master' into z3_coalesced_fetch
f2752f82
inkcherry update ut
22c0f81c
inkcherry udpate
f7732580
inkcherry change config name, refine doc
c31ad023
inkcherry fix rjust size
40ceeac4
inkcherry fix merge
73e5bd54
inkcherry format
c31c8d21
inkcherry always print info if the config is enabled
619cbe68
inkcherry Merge branch 'master' into z3_coalesced_fetch
3c0a1830
inkcherry update
a6e5a399
inkcherry Merge branch 'z3_coalesced_fetch' of https://github.com/inkcherry/Dee…
e7e5cdf3
inkcherry Merge remote-tracking branch 'upstream/master' into z3_coalesced_fetch
00ac4eb5
inkcherry use mark parametrize for test
25df9623
inkcherry opt loop
663e6370
inkcherry inkcherry force pushed from ed91abcf to d9c36870 1 year ago
inkcherry inkcherry force pushed from d9c36870 to 663e6370 1 year ago
inkcherry inkcherry requested a review from loadams loadams 1 year ago
inkcherry update
13aaf2fe
inkcherry Use fast fetch only for the case of z3_leaf_module with fine-grained …
063e5b91
inkcherry Merge branch 'master' into reduce_coalesced_fetch_bubble
444d586a
inkcherry update
5e9f2e81
inkcherry Merge branch 'master' into reduce_coalesced_fetch_bubble
21b38234
inkcherry Merge branch 'master' into reduce_coalesced_fetch_bubble
26ffcf71
inkcherry
tjruwase tjruwase removed review request from awan-10 awan-10 1 year ago
tjruwase
tjruwase commented on 2024-12-24
inkcherry Move the condition outside the loop
931c1213
inkcherry update condition&comments
8d595657
inkcherry Swap the order of the conditions
59fef783
tjruwase
tjruwase commented on 2024-12-25
inkcherry rename arg name&fix ut
335db94c
tjruwase
tjruwase approved these changes on 2024-12-26
inkcherry fix ut
c7b44414
inkcherry Merge branch 'master' into reduce_coalesced_fetch_bubble
4f317b89
inkcherry
loadams
loadams Merge branch 'master' into reduce_coalesced_fetch_bubble
99de70e6
loadams Merge branch 'master' into reduce_coalesced_fetch_bubble
1517d712
loadams loadams enabled auto-merge 355 days ago
loadams loadams merged b0040b6c into master 355 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum