PR #27274 Track the number of tokens seen to metrics

Track the number of tokens seen to metrics #27274

muellerzr merged 6 commits into main from tokens-seen

muellerzr requested a review from

pacman100 2 years ago

muellerzr requested a review from

amyeroberts 2 years ago

amyeroberts commented on 2023-11-06

muellerzr requested a review from

amyeroberts 2 years ago

amyeroberts approved these changes on 2023-11-07

muellerzr force pushed from 03f74e7a 2 years ago

muellerzr force pushed to d01ba62b 2 years ago

Add tokens seen

6d1bd941

Address comments, add to TrainingArgs

46f8b296

Update log

7ef3d271

Apply suggestions from code review

8c5156eb

Use self.args

8481a8e1

muellerzr force pushed from d01ba62b to 8481a8e1 2 years ago

amyeroberts approved these changes on 2023-11-14

Fix docstring

f81dcf89

muellerzr merged 2fc33ebe into main 2 years ago

muellerzr deleted the tokens-seen branch 2 years ago

Reviewers

amyeroberts

pacman100

Assignees

No one assigned

Labels

None yet

Milestone

No milestone