Fix dtype mismatch in grouped_mm_fallback for LoRA training on Mamba+… (#47933)
* Fix dtype mismatch in grouped_mm_fallback for LoRA training on Mamba+MoE models
Ensure tensor dtype consistency in matrix multiplications.
* Apply ruff formatting
* Apply suggestions from code review
Co-authored-by: Ilyas Moutawwakil <57442720+IlyasMoutawwakil@users.noreply.github.com>
---------
Co-authored-by: Ilyas Moutawwakil <57442720+IlyasMoutawwakil@users.noreply.github.com>