accelerate
71036329 - tensor parallel dataloder for deepspeed accelerator (#3390)

Commit
1 year ago
tensor parallel dataloder for deepspeed accelerator (#3390) * ds tp change * update * format * add version check * Update src/accelerate/accelerator.py Co-authored-by: Zach Mueller <muellerzr@gmail.com> * Update src/accelerate/accelerator.py Co-authored-by: Zach Mueller <muellerzr@gmail.com> * put device_mesh logic to func + format * fix comments * format --------- Co-authored-by: Zach Mueller <muellerzr@gmail.com>
Author
Parents
Loading