Fix vits low-precision dtype (#35418)
* fix vits dtype
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* add tests
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* use weight dtype
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
---------
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
