DeepSpeed
Use CUDA events for inference model profiling
#2371
Merged

Use CUDA events for inference model profiling #2371

mrwyattii merged 8 commits into master from cuda-event-inf-profiler
mrwyattii
mrwyattii use cuda event timers
5cd251fd
mrwyattii added unit test
d8c87f76
mrwyattii mrwyattii marked this pull request as ready for review 3 years ago
mrwyattii mrwyattii requested a review from jeffra jeffra 3 years ago
mrwyattii mrwyattii requested a review from samyam samyam 3 years ago
mrwyattii mrwyattii requested a review from tjruwase tjruwase 3 years ago
mrwyattii mrwyattii requested a review from ShadenSmith ShadenSmith 3 years ago
mrwyattii mrwyattii requested a review from conglongli conglongli 3 years ago
mrwyattii mrwyattii requested a review from awan-10 awan-10 3 years ago
mrwyattii mrwyattii requested a review from cli99 cli99 3 years ago
mrwyattii mrwyattii requested a review from eltonzheng eltonzheng 3 years ago
mrwyattii mrwyattii requested a review from minjiaz minjiaz 3 years ago
mrwyattii mrwyattii requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
mrwyattii mrwyattii requested a review from duli2012 duli2012 3 years ago
mrwyattii mrwyattii requested a review from yaozhewei yaozhewei 3 years ago
mrwyattii mrwyattii requested a review from arashb arashb 3 years ago
mrwyattii mrwyattii requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
mrwyattii mrwyattii requested a review from samadejacobs samadejacobs 3 years ago
mrwyattii mrwyattii requested a review from cmikeh2 cmikeh2 3 years ago
mrwyattii mrwyattii requested a review from GuanhuaWang GuanhuaWang 3 years ago
mrwyattii Merge branch 'master' into cuda-event-inf-profiler
b3b35ae9
mrwyattii Merge branch 'master' into cuda-event-inf-profiler
a2c8fe86
mrwyattii added additional models to test
0570a751
awan-10
awan-10 approved these changes on 2022-10-04
mrwyattii add cuda events as timing option (on by default)
3b7754db
mrwyattii Merge branch 'master' into cuda-event-inf-profiler
a30c17be
mrwyattii Merge branch 'master' into cuda-event-inf-profiler
b09afb99
mrwyattii mrwyattii merged e772f166 into master 3 years ago
mrwyattii mrwyattii deleted the cuda-event-inf-profiler branch 2 years ago

Login to write a write a comment.

Login via GitHub