transformers
Fix `num_items_in_batch` over-counting for causal LM losses
#46204

Merged

Fix `num_items_in_batch` over-counting for causal LM losses #46204

vasqu merged 4 commits into main from fix-num-items-in-batch-causal-lm-v2

Fix `num_items_in_batch` over-counting for causal LM losses

22d3aeb2

qgallouedec requested a review from

SunMarc 42 days ago

qgallouedec requested a review from

vasqu 42 days ago

vasqu commented on 2026-05-26

SunMarc commented on 2026-05-27

Address review: use LOSS_MAPPING, honor pre-shifted labels, add tests

decd9591

Merge branch 'main' into fix-num-items-in-batch-causal-lm-v2

4d09230d

SunMarc approved these changes on 2026-05-27

vasqu enabled auto-merge 41 days ago

fix test_train_and_predict_loss_parity

0a3d375c

vasqu merged 67265ef5 into main 41 days ago

vasqu deleted the fix-num-items-in-batch-causal-lm-v2 branch 41 days ago

Reviewers

SunMarc

vasqu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone