DeepSpeed
9726bd46 - Fix comms benchmark import issues and support MPI/slurm launching (#2932)

Commit
2 years ago
Fix comms benchmark import issues and support MPI/slurm launching (#2932) * Fix benchmark import issues and support MPI launching with pure torch.dist * Formatting * Update comms benchmark README * Formatting * Added better error handling and support MPI torch.dist backend * Update formatting versions * Formatting again * Trigger CI --------- Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Parents
  • benchmarks/communication
    • File
      README.md
    • File
      all_gather.py
    • File
      all_reduce.py
    • File
      all_to_all.py
    • File
      broadcast.py
    • File
      constants.py
    • File
      pt2pt.py
    • File
      run_all.py
    • File
      utils.py