batched_mm is slow on cpu (#43438)
* batched_mm is slow on cpu
* comments and docs
* Apply suggestion from @stevhliu
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
* Apply suggestion from @stevhliu
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
* Update docs/source/en/experts_interface.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
* table and note
* fix groued_mm+cpu+compile tests by using bf16
* Update docs/source/en/experts_interface.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>