DeepSpeed
Release swap buffers for persisted params
#2089
Merged
Overview
Commits
47
Changes
View On GitHub

Release swap buffers for persisted params #2089

tjruwase merged 47 commits into master from olruwase/parameter_offload
tjruwase
tjruwase Split parameter offload from z3
f968eefd
tjruwase Format fixes
984deaff
tjruwase Bug fixes
1219ed86
tjruwase Merge branch 'master' into olruwase/parameter_offload
37a24057
tjruwase Merge branch 'master' into olruwase/parameter_offload
16088e69
tjruwase Cleanup
e3e346db
tjruwase Merge branch 'olruwase/parameter_offload' of github.com:microsoft/Dee…
e83936ed
tjruwase Remove dead code
e1220289
tjruwase Merge branch 'master' into olruwase/parameter_offload
2a1b2451
tjruwase Merge branch 'master' into olruwase/parameter_offload
55739669
tjruwase Merge branch 'master' into olruwase/parameter_offload
e86c41ff
tjruwase Merge branch 'master' into olruwase/parameter_offload
60111c5c
tjruwase Merge branch 'master' into olruwase/parameter_offload
92b90f30
tjruwase Merge branch 'master' into olruwase/parameter_offload
afb6f6cb
tjruwase Merge branch 'master' into olruwase/parameter_offload
ecc34b17
tjruwase Merge branch 'master' into olruwase/parameter_offload
8993ec43
tjruwase Release swap buffers for persisted params
59dc8f14
tjruwase Merge branch 'olruwase/parameter_offload' of github.com:microsoft/Dee…
a1757547
tjruwase Merge with master
a266275e
tjruwase tjruwase requested a review from jeffra jeffra 3 years ago
tjruwase tjruwase requested a review from samyam samyam 3 years ago
tjruwase tjruwase requested a review from mrwyattii mrwyattii 3 years ago
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 3 years ago
tjruwase tjruwase requested a review from conglongli conglongli 3 years ago
tjruwase tjruwase requested a review from awan-10 awan-10 3 years ago
tjruwase tjruwase requested a review from cli99 cli99 3 years ago
tjruwase tjruwase requested a review from eltonzheng eltonzheng 3 years ago
tjruwase tjruwase requested a review from minjiaz minjiaz 3 years ago
tjruwase tjruwase requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
tjruwase tjruwase requested a review from duli2012 duli2012 3 years ago
tjruwase tjruwase requested a review from yaozhewei yaozhewei 3 years ago
tjruwase tjruwase requested a review from arashb arashb 3 years ago
tjruwase tjruwase requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
tjruwase tjruwase requested a review from samadejacobs samadejacobs 3 years ago
tjruwase Format fixes
c5ae3d69
tjruwase Format fixes
9954b8f6
tjruwase Pass args correctly
c6cfb55a
tjruwase Merge branch 'master' into olruwase/parameter_offload
31ccf6d9
tjruwase Use pinned memory for nvme offload
2f4ccc44
tjruwase Merge branch 'olruwase/parameter_offload' of github.com:microsoft/Dee…
8b4a70df
tjruwase Merge branch 'master' into olruwase/parameter_offload
e5b7ca16
tjruwase Merge branch 'master' into olruwase/parameter_offload
d3bdbc44
tjruwase tjruwase removed review request from arashb arashb 3 years ago
tjruwase tjruwase removed review request from ShadenSmith ShadenSmith 3 years ago
tjruwase tjruwase removed review request from duli2012 duli2012 3 years ago
tjruwase tjruwase removed review request from conglongli conglongli 3 years ago
tjruwase tjruwase removed review request from awan-10 awan-10 3 years ago
tjruwase tjruwase removed review request from cli99 cli99 3 years ago
tjruwase tjruwase removed review request from yaozhewei yaozhewei 3 years ago
tjruwase tjruwase removed review request from eltonzheng eltonzheng 3 years ago
tjruwase tjruwase removed review request from minjiaz minjiaz 3 years ago
tjruwase tjruwase removed review request from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
tjruwase tjruwase removed review request from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
tjruwase tjruwase requested a review from GuanhuaWang GuanhuaWang 3 years ago
tjruwase Merge branch 'master' into olruwase/parameter_offload
6e86f8c7
tjruwase Merge with masster
c2a8913b
tjruwase Merge with masster
c3fb27a0
tjruwase Fix missing import
80a7deb1
tjruwase model pesistence params
e858891e
tjruwase Merge branch 'master' into olruwase/parameter_offload
263ad480
tjruwase Merge branch 'master' into olruwase/parameter_offload
ff682c91
tjruwase Merge branch 'master' into olruwase/parameter_offload
7de4e465
tjruwase Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase…
88462a33
tjruwase Merge branch 'master' into olruwase/parameter_offload
b53e9131
tjruwase Merge branch 'olruwase/parameter_offload' of github.com:microsoft/Dee…
fcbef1f9
tjruwase Fix merge issues
0ec1f8fa
tjruwase Handle none device
5db1b8cf
tjruwase Merge branch 'master' into olruwase/parameter_offload
428964a4
tjruwase Merge branch 'master' into olruwase/parameter_offload
49c1f78d
mrwyattii
mrwyattii requested changes on 2022-07-28
tjruwase Merge branch 'master' into olruwase/parameter_offload
0309b014
tjruwase Usse log_dist
bc205d81
tjruwase Merge branch 'olruwase/parameter_offload' of github.com:microsoft/Dee…
126ab130
mrwyattii
mrwyattii approved these changes on 2022-07-29
tjruwase Merge branch 'master' into olruwase/parameter_offload
43b8f97d
tjruwase Merge branch 'master' into olruwase/parameter_offload
45a8e9e9
tjruwase tjruwase merged 2210ebe7 into master 3 years ago
mrwyattii mrwyattii deleted the olruwase/parameter_offload branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum