transformers

6c5d4b1d - allow custom head_dim for qwen2_moe (#37188)

allow custom head_dim for qwen2_moe (#37188) allow custom head_dim Co-authored-by: ryan.agile <ryan.agile@kakaobrain.com> Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>