Update conv_base to support empty batch (#16603)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/16603
Update conv_base to support empty batch
Reviewed By: houseroad
Differential Revision: D13894111
fbshipit-source-id: fc4370ff16ba6046f374e77bd845d28e6af05ea3
