Revert "Implement adding bias vector into structured sparse linear operator (#100881)"
This reverts commit c3a893c659bebf0e5b62452a751c4e6ab3dc5b2d.
Reverted https://github.com/pytorch/pytorch/pull/100881 on behalf of https://github.com/izaitsevfb due to breaks internal builds, see D45972633 ([comment](https://github.com/pytorch/pytorch/pull/100881#issuecomment-1553621418))
