Add APIs to offload states of model, optimizer, and engine #6011
tohtana
merged
28 commits into
master
from
tohtana/offload_zero_buffers
add apis to offload states of model, optimizer, and engine
58251044
update api doc
600c8226
Merge branch 'master' into tohtana/offload_zero_buffers
153a482f
reduce global reference to buffer
126d9b7f
loosen type hint
05df37c5
Merge branch 'master' into tohtana/offload_zero_buffers
837c06c8
add option for pin_memory and non blocking copy
3f8179db
fix offloading of lp grad
37ffa021
add verification in test
93c5a906
improve offloading of lp params
512e9c9f
Merge branch 'master' into tohtana/offload_zero_buffers
de2a8945
fix pinning
c749b05c
Merge branch 'master' into tohtana/offload_zero_buffers
36d6e100
resolve conflict
af95a378
tjruwase
commented
on 2024-09-03
tjruwase
commented
on 2024-09-03
Merge branch 'master' into tohtana/offload_zero_buffers
1ca3a7f7
tjruwase
commented
on 2024-09-03
fix method name and enum key
2a4733ee
tjruwase
commented
on 2024-09-03
tjruwase
commented
on 2024-09-03
tjruwase
commented
on 2024-09-03
tjruwase
commented
on 2024-09-03
tjruwase
commented
on 2024-09-03
elimitate duplicated buffer for lp param
e9a499ef
simplified offloding of adam states
b8f47c6c
validate devcies of offload states
d3380790
tjruwase
approved these changes
on 2024-09-04
add document
15ff7b38
Merge branch 'master' into tohtana/offload_zero_buffers
40427c19
fix usage example
e20d827f
Merge branch 'tohtana/offload_zero_buffers' of github.com:microsoft/D…
031464dd
Merge branch 'master' into tohtana/offload_zero_buffers
60deaf1d
Merge branch 'master' into tohtana/offload_zero_buffers
3f001b61
Merge branch 'master' into tohtana/offload_zero_buffers
8f81634e
Merge branch 'master' into tohtana/offload_zero_buffers
ff8e1e97
Merge branch 'master' into tohtana/offload_zero_buffers
02a6a18e
Login to write a write a comment.
Login via GitHub