transformers
4ad91995 - Fix dtype mismatch in grouped_mm_fallback for LoRA training on Mamba+… (#47933)

Commit
3 days ago
Fix dtype mismatch in grouped_mm_fallback for LoRA training on Mamba+… (#47933) * Fix dtype mismatch in grouped_mm_fallback for LoRA training on Mamba+MoE models Ensure tensor dtype consistency in matrix multiplications. * Apply ruff formatting * Apply suggestions from code review Co-authored-by: Ilyas Moutawwakil <57442720+IlyasMoutawwakil@users.noreply.github.com> --------- Co-authored-by: Ilyas Moutawwakil <57442720+IlyasMoutawwakil@users.noreply.github.com>
Author
Parents
Loading