accelerate
Add NUMA affinity control for NVIDIA GPUs
#2535
Merged
Overview
Commits
15
Changes
View On GitHub

Add NUMA affinity control for NVIDIA GPUs #2535

muellerzr merged 15 commits into main from affinity
muellerzr
muellerzr Beta test, could break!
9e439566
muellerzr Cleanup and get rid of unneded files
68faae33
muellerzr Work on integration
7b84f0ee
muellerzr Add numa affinity to config
439bbb34
muellerzr Add to config command
86264d96
muellerzr muellerzr requested a review from BenjaminBossan BenjaminBossan 2 years ago
HuggingFaceDocBuilderDev
BenjaminBossan
BenjaminBossan commented on 2024-03-07
stas00
stas00 commented on 2024-03-08
stas00
stas00 commented on 2024-03-08
muellerzr Fix some of Stas' notes
24ade7c1
muellerzr Use raw os to make things easier
fc68ef43
muellerzr Update questionairre
44b40f4e
muellerzr Use CPU_AFFINITY instead
407c548d
muellerzr Change doc
768939ba
muellerzr Update test
a4e3fc41
muellerzr muellerzr requested a review from stas00 stas00 2 years ago
muellerzr
muellerzr muellerzr requested a review from BenjaminBossan BenjaminBossan 2 years ago
BenjaminBossan
BenjaminBossan approved these changes on 2024-03-14
stas00
stas00 approved these changes on 2024-03-15
Fix numa, I submit
fc7b29a8
muellerzr
muellerzr Merge branch 'main' into affinity
705a9015
muellerzr include ref to original
b6ebdc2c
muellerzr muellerzr requested a review from BenjaminBossan BenjaminBossan 2 years ago
muellerzr muellerzr requested a review from stas00 stas00 2 years ago
muellerzr Fix
568471dc
muellerzr
muellerzr muellerzr merged b8b353b7 into main 2 years ago
muellerzr muellerzr deleted the affinity branch 2 years ago
muellerzr muellerzr removed review request from BenjaminBossan BenjaminBossan 2 years ago
muellerzr muellerzr removed review request from stas00 stas00 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum