transformers

266c67b0 - [`Mixtral` / `Awq`] Add mixtral fused modules for Awq (#28240)

[`Mixtral` / `Awq`] Add mixtral fused modules for Awq (#28240) * add mixtral fused modules * add changes from modeling utils * add test * fix test + rope theta issue * Update src/transformers/modeling_utils.py Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * add tests --------- Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>