pytorch
1f2b96e7 - [DDP] Make compute_bucket_assignment_by_size return per bucket sizes (#62231)

Commit
3 years ago
[DDP] Make compute_bucket_assignment_by_size return per bucket sizes (#62231) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/62231 `compute_bucket_assignment_by_size` is responsible for setting per-bucket size limits, return this information from the function so that we are aware of size limits for each bucket. This is currently not being consumed, but will be in the next diff when we log bucket size limits to DDP logging. This will help us run experiments under different bucket size configs and analyze the impact. ghstack-source-id: 134480575 Test Plan: CI Reviewed By: mrshenli Differential Revision: D29919056 fbshipit-source-id: dd5a096fa23d22e5d9dc1602899270a110db4a19
Author
Parents
Loading