DeepSpeed
Comms Benchmarks
#2040
Merged
Overview
Commits
19
Changes
View On GitHub

Comms Benchmarks #2040

jeffra merged 19 commits into master from qanthony/comms-bench
Quentin-Anthony
Quentin-Anthony Add v1 allreduce benchmark
cd2fecf7
Quentin-Anthony test credentials
243858b8
Quentin-Anthony Add WIP benchmarks
15ca89e7
Quentin-Anthony Quentin-Anthony requested a review from jeffra jeffra 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from samyam samyam 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from tjruwase tjruwase 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from ShadenSmith ShadenSmith 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from conglongli conglongli 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from awan-10 awan-10 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from cli99 cli99 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from eltonzheng eltonzheng 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from minjiaz minjiaz 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from duli2012 duli2012 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from mrwyattii mrwyattii 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from yaozhewei yaozhewei 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from arashb arashb 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
Quentin-Anthony Quentin-Anthony marked this pull request as draft 3 years ago
Quentin-Anthony Change single runs to automatically use max message size
b154d359
Quentin-Anthony Add pt2pt and README. Make mem_factor an arg.
31f96941
Quentin-Anthony Clean up
655f1131
Quentin-Anthony Make debug alltoall-specific
0edfbaff
Quentin-Anthony
Quentin-Anthony Quentin-Anthony marked this pull request as ready for review 3 years ago
Quentin-Anthony Delete runall.py
feaa1499
Quentin-Anthony Delete all_reduce_v2.py
d8a5f3f9
Quentin-Anthony Move benchmarks
34caa84e
Quentin-Anthony Merge branch 'qanthony/comms-bench' of https://github.com/microsoft/D…
682b4aa3
Quentin-Anthony Remove unnecessary DS imports and double headers
917da1ce
Quentin-Anthony Added ds_bench, abstracted out args, error handling
babab4f7
Quentin-Anthony Add ds_bench to setup and README
240df2ca
Quentin-Anthony No longer package ds_bench with setup.py
c3ec062f
Quentin-Anthony Fix ds_bench, fix args, fix dtypes, fix bw_unit
c6370044
Quentin-Anthony Fixed allgather mem_factor
45e6b350
Quentin-Anthony Merge branch 'master' into qanthony/comms-bench
7b9cfdd4
jeffra Merge branch 'master' into qanthony/comms-bench
3f41143d
jeffra
jeffra approved these changes on 2022-06-29
jeffra jeffra merged 9b70ce56 into master 3 years ago
jeffra jeffra deleted the qanthony/comms-bench branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum