[sparsity][refactor] Changing linear row/col control (#60850)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/60850
Test Plan:
```
python test/test_ao_sparsity.py
```
```
python test/test_ao_sparsity.py
```
Differential Revision:
D29465900
D29465900
Reviewed By: raghuramank100
Pulled By: z-a-f
fbshipit-source-id: 412f50da857f377898fea79d378ae54a049b81fe