pytorch
4d55ea85 - [spmd] enhance batch dim analysis of data parallel (#100852)

Commit
1 year ago
[spmd] enhance batch dim analysis of data parallel (#100852) This PR enhances batch dim analysis of data parallel to understand more on the cases where batch dim get flattened or split, using dtensor's view ops, we could be able to track the batch dim that got transformed in non-trival ways. Pull Request resolved: https://github.com/pytorch/pytorch/pull/100852 Approved by: https://github.com/mrshenli
Author
Committer
Parents
Loading