DeepSpeed
[CPU support] Optionally bind each rank to different cores on host
#2881
Merged
Overview
Commits
47
Changes
View On GitHub

[CPU support] Optionally bind each rank to different cores on host #2881

tjruwase merged 47 commits into deepspeedai:master from delock:gma/numactl
delock
delock add fallback path for kernels used in megatron
edf1c128
delock temporary numactl WA for SPR 56core
9a89405d
delock adapt core allocation according to number of ranks
d1b8f137
delock add switch to turn on numactl
e31439ed
delock detect number of cores on the system
c5828f75
allow select a subset of the cores on the system to bind
6b9dcd2f
delock Merge branch 'up-master' into gma/numactl
4031a6e7
delock remove unneeded changes
893c18de
delock delock requested a review from jeffra jeffra 3 years ago
delock delock requested a review from awan-10 awan-10 3 years ago
delock Merge branch 'master' into gma/numactl
3551850d
delock Merge branch 'master' into gma/numactl
7ed25d46
delock Merge branch 'master' into gma/numactl
79ed887e
delock Merge branch 'master' into gma/numactl
07f4eb15
tjruwase Merge branch 'master' into gma/numactl
04bad298
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 3 years ago
tjruwase tjruwase requested a review from tjruwase tjruwase 3 years ago
tjruwase Merge branch 'master' into gma/numactl
0f4e9e59
ShadenSmith
ShadenSmith commented on 2023-03-01
delock use current_env to set OMP_NUM_THREADS in subprocess
c9c7d625
delock add test for ds_arguments
164f9b0a
delock change --bind_cores_to_rank option to store_true
99d2193c
delock add test for parse_range_list
8cb5cd76
delock add comment for parse range list
55055477
delock add test for parse range list, rewrite parse_range_list
211b1244
delock delock requested a review from mrwyattii mrwyattii 3 years ago
delock
delock fix format error
c39d9170
delock Merge branch 'master' into gma/numactl
d5576413
delock fix format
0550597d
delock Merge branch 'master' into gma/numactl
3138c96b
delock Merge branch 'master' into gma/numactl
28cc8d74
delock Merge branch 'master' into gma/numactl
a8b5a22d
delock add -m parameter to numactl when necessary
f0f929b1
delock
tjruwase Merge branch 'master' into gma/numactl
15b3db4b
delock Check KMP_AFFINITY to avoid conflict with numactl
8e08b36c
delock
delock Merge branch 'master' into gma/numactl
ccc8b9de
delock Merge branch 'master' into gma/numactl
2e84dee4
delock Merge branch 'master' into gma/numactl
8f0781d5
delock Merge branch 'master' into gma/numactl
d50be939
delock Merge branch 'master' into gma/numactl
c6389a5d
delock fix format
edfe0e40
delock Merge branch 'master' into gma/numactl
7510d45b
tjruwase
tjruwase commented on 2023-04-05
delock negative case for parse_range_list
1c9953d9
delock Merge branch 'master' into gma/numactl
637e0869
jeffra
jeffra commented on 2023-04-06
delock detect whether numactl is installed before use numactl to bind cores
f72d5767
tjruwase
tjruwase approved these changes on 2023-04-07
tjruwase Merge branch 'master' into gma/numactl
42ac7138
tjruwase Merge branch 'master' into gma/numactl
e4c2c0e6
delock check numactl with package manager of distro
54f6f809
tjruwase Merge branch 'master' into gma/numactl
ce476580
tjruwase Merge branch 'master' into gma/numactl
2f06e1c0
tjruwase Merge branch 'master' into gma/numactl
681f9216
tjruwase Merge branch 'master' into gma/numactl
5c888bf3
tjruwase Merge branch 'master' into gma/numactl
1ec21e09
tjruwase tjruwase merged 0b5252bb into master 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum