Clean up prefetched parameters #6557
loadams
merged
37 commits into
master
from
tohtana/clean_up_prefetch_param
add apis to offload states of model, optimizer, and engine
58251044
update api doc
600c8226
Merge branch 'master' into tohtana/offload_zero_buffers
153a482f
reduce global reference to buffer
126d9b7f
loosen type hint
05df37c5
Merge branch 'master' into tohtana/offload_zero_buffers
837c06c8
add option for pin_memory and non blocking copy
3f8179db
fix offloading of lp grad
37ffa021
add verification in test
93c5a906
improve offloading of lp params
512e9c9f
Merge branch 'master' into tohtana/offload_zero_buffers
de2a8945
fix pinning
c749b05c
Merge branch 'master' into tohtana/offload_zero_buffers
36d6e100
resolve conflict
af95a378
Merge branch 'master' into tohtana/offload_zero_buffers
1ca3a7f7
fix method name and enum key
2a4733ee
elimitate duplicated buffer for lp param
e9a499ef
simplified offloding of adam states
b8f47c6c
validate devcies of offload states
d3380790
add document
15ff7b38
Merge branch 'master' into tohtana/offload_zero_buffers
40427c19
fix usage example
e20d827f
Merge branch 'tohtana/offload_zero_buffers' of github.com:microsoft/D…
031464dd
Merge branch 'master' into tohtana/offload_zero_buffers
60deaf1d
Merge branch 'master' into tohtana/offload_zero_buffers
3f001b61
Merge branch 'master' into tohtana/offload_zero_buffers
8f81634e
clean up inflight status params
7bc3c668
Merge branch 'master' into tohtana/clean_up_prefetch_param
3c5089f4
Merge branch 'master' into tohtana/clean_up_prefetch_param
45fea6e3
Merge branch 'master' into tohtana/clean_up_prefetch_param
1963137a
Merge branch 'master' into tohtana/clean_up_prefetch_param
ce8636a3
tjruwase
approved these changes
on 2024-10-07
clean inflight registry when invalidating trace
c89d5763
Merge branch 'master' into tohtana/clean_up_prefetch_param
70ea4121
Merge branch 'master' into tohtana/clean_up_prefetch_param
e92f5494
Merge branch 'master' into tohtana/clean_up_prefetch_param
9b7e0b84
loadams
approved these changes
on 2024-10-08
Merge branch 'master' into tohtana/clean_up_prefetch_param
2a2b3eeb
Merge branch 'master' into tohtana/clean_up_prefetch_param
47af7055
Login to write a write a comment.
Login via GitHub