DeepSpeed
Use one param coordinator for both train/inference scenarios
#6662
Merged

Use one param coordinator for both train/inference scenarios #6662

tohtana merged 16 commits into master from tohtana/simplify_param_coordinator
tohtana
use one param coordinator for both train/inference modes
723289f8
fix initial trace mode
b3b7bc94
stop tracing for compiler from modifying prefetch info
c4ac674e
remove arg to choose param coordinator
cb2b25d9
tohtana Merge branch 'master' into tohtana/simplify_param_coordinator
ba3c00c2
tohtana Merge branch 'master' into tohtana/simplify_param_coordinator
02d044ed
test prefetching while switching modes
04d9dda7
Merge branch 'tohtana/simplify_param_coordinator' of github.com:micro…
54525e06
tohtana tohtana marked this pull request as ready for review 1 year ago
tohtana tohtana requested a review from tjruwase tjruwase 1 year ago
tohtana tohtana requested a review from loadams loadams 1 year ago
tohtana Merge branch 'master' into tohtana/simplify_param_coordinator
92a0dd03
change test parameter
acb9efa8
Merge branch 'tohtana/simplify_param_coordinator' of github.com:micro…
d24eb643
tjruwase Merge branch 'master' into tohtana/simplify_param_coordinator
8d67ddda
tohtana Merge branch 'master' into tohtana/simplify_param_coordinator
2728865b
loadams Merge branch 'master' into tohtana/simplify_param_coordinator
ba9bd3cb
loadams Merge branch 'master' into tohtana/simplify_param_coordinator
85d7818c
replace is_compiling calls with wrapper
db8f2cf0
tohtana tohtana enabled auto-merge 1 year ago
tjruwase
tjruwase approved these changes on 2024-11-05
tohtana tohtana merged 351569dd into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone