transformers
fix gemma4 gradient accumulation loss and last token incorrect labels
#45354

Merged

fix gemma4 gradient accumulation loss and last token incorrect labels #45354

Cyrilvallez merged 2 commits into huggingface:main from winglian:fix-gemma4

fix gemma4 gradient accumulation loss and last token incorrect labels

22295218

modular + also gemma3n

72617200

Cyrilvallez approved these changes on 2026-04-10

Cyrilvallez enabled auto-merge 75 days ago

Cyrilvallez merged 47d77657 into main 75 days ago

Reviewers

Cyrilvallez

Assignees

No one assigned

Labels

None yet

Milestone

No milestone