Remove `torch_dtype` in to() to end deprecation (#6886)
* remove torch_dtype from to()
* remove torch_dtype from usage scripts.
* remove old lora backend
* Revert "remove old lora backend"
This reverts commit adcddf6ba421f847e7da2a0ce57b9456cae43356.
