transformers
Try to fix training Loss inconsistent after resume from old checkpoint
#25872

Merged

Try to fix training Loss inconsistent after resume from old checkpoint #25872

amyeroberts merged 10 commits into huggingface:main from patch-1

fix loss inconsistent after resume #25340

39c3fbdc

fix typo

2823a53a

dumpmemory changed the title ~~Try to fix #25340~~ Try to fix https://github.com/huggingface/transformers/issues/25340 2 years ago

dumpmemory changed the title ~~Try to fix https://github.com/huggingface/transformers/issues/25340~~ Try to fix training Loss inconsistent after resume from old checkpoint 2 years ago

clean code

71010cb3

reformatted code

b4c38a35

muellerzr approved these changes on 2023-08-30

amyeroberts commented on 2023-08-30

adjust code according to comments

67223ae4

adjust check_dataloader_randomsampler location

401d4435

amyeroberts commented on 2023-08-31

return sampler only

dfb06a53

dumpmemory requested a review from

amyeroberts 2 years ago

amyeroberts commented on 2023-09-05

handle sampler is None

807512c4

amyeroberts commented on 2023-09-06

Update src/transformers/trainer_pt_utils.py

49146c8c

amyeroberts approved these changes on 2023-09-06

muellerzr approved these changes on 2023-09-06

Merge branch 'huggingface:main' into patch-1

af7ce6d9

amyeroberts merged fb7d2469 into main 2 years ago

Reviewers

muellerzr

amyeroberts

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Try to fix training Loss inconsistent after resume from old checkpoint #25872 Merged

Try to fix training Loss inconsistent after resume from old checkpoint #25872

transformers
Try to fix training Loss inconsistent after resume from old checkpoint
#25872

Merged