DeepSpeed
Add API to get devices of offload states
#6586
Merged

Add API to get devices of offload states #6586

tohtana merged 36 commits into master from tohtana/get_offload_state_api
tohtana
add apis to offload states of model, optimizer, and engine
58251044
update api doc
600c8226
tohtana Merge branch 'master' into tohtana/offload_zero_buffers
153a482f
reduce global reference to buffer
126d9b7f
loosen type hint
05df37c5
Merge branch 'master' into tohtana/offload_zero_buffers
837c06c8
add option for pin_memory and non blocking copy
3f8179db
fix offloading of lp grad
37ffa021
add verification in test
93c5a906
improve offloading of lp params
512e9c9f
tohtana Merge branch 'master' into tohtana/offload_zero_buffers
de2a8945
fix pinning
c749b05c
tohtana Merge branch 'master' into tohtana/offload_zero_buffers
36d6e100
resolve conflict
af95a378
tohtana Merge branch 'master' into tohtana/offload_zero_buffers
1ca3a7f7
fix method name and enum key
2a4733ee
elimitate duplicated buffer for lp param
e9a499ef
simplified offloding of adam states
b8f47c6c
validate devcies of offload states
d3380790
add document
15ff7b38
loadams Merge branch 'master' into tohtana/offload_zero_buffers
40427c19
fix usage example
e20d827f
Merge branch 'tohtana/offload_zero_buffers' of github.com:microsoft/D…
031464dd
tohtana Merge branch 'master' into tohtana/offload_zero_buffers
60deaf1d
tohtana Merge branch 'master' into tohtana/offload_zero_buffers
3f001b61
tohtana Merge branch 'master' into tohtana/offload_zero_buffers
8f81634e
tohtana Merge branch 'master' into tohtana/offload_zero_buffers
ff8e1e97
tjruwase Merge branch 'master' into tohtana/offload_zero_buffers
02a6a18e
refactor to extract API to get devices of offload states
703333ca
Merge branch 'master'
5ecc2c9f
fix import and add license
338e4e0d
fix document
71021930
tohtana tohtana requested a review from tjruwase tjruwase 1 year ago
tohtana tohtana requested a review from loadams loadams 1 year ago
tjruwase Merge branch 'master' into tohtana/get_offload_state_api
fdcc0a42
tjruwase
tjruwase approved these changes on 2024-10-02
tohtana Merge branch 'master' into tohtana/get_offload_state_api
935b0695
tohtana Merge branch 'master' into tohtana/get_offload_state_api
6bcbd584
tohtana tohtana enabled auto-merge 1 year ago
tohtana Merge branch 'master' into tohtana/get_offload_state_api
c335571a
tohtana tohtana merged adec9912 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone