transformers

13e645bb - Allow-head-dim (#32857)

Allow-head-dim (#32857) * support head dim * fix the doc * fixup * add oproj Co-authored-by: Suhara <suhara@users.noreply.github.com>> * update Co-authored-by: bzantium <bzantium@users.noreply.github.com> * Co-authored-by: suhara <suhara@users.noreply.github.com> * Update Co-authored-by: Yoshi Suhara <suhara@users.noreply.github.com> --------- Co-authored-by: bzantium <bzantium@users.noreply.github.com> Co-authored-by: Yoshi Suhara <suhara@users.noreply.github.com>