Fix model parallel bugs for Gemma4 (#45817)
* fix model parallel issue for gemma4
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* skip FA2 equivalance test cases
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* update output
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* update code
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* update
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* Update src/transformers/models/gemma4/modeling_gemma4.py
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
* update code
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* fix LINT issue
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
* Apply repo consistency fixes
---------
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
