PR #35121 Fix GA loss bugs and add unit test

Fix GA loss bugs and add unit test #35121

ArthurZucker merged 9 commits into huggingface:main from main

muellerzr approved these changes on 2024-12-06

ArthurZucker commented on 2024-12-07

fix GA bugs and add unit test

8382b5a7

narrow down model loss unit test diff gap

deb67d81

format code to make ruff happy

b985a20a

send num_items_in_batch argument to decoder

72b9b148

fix GA loss bug in BertLMHeadModel

8460bad6

use TinyStories-33M to narrow down diff gap

b132be98

fotmat code

d4612648

missing .config

5abba30a

avoid add extra args

893058d8

ArthurZucker approved these changes on 2024-12-09

ArthurZucker merged 1ccca8f4 into main 1 year ago

Reviewers

ArthurZucker

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone