huggingface/lighteval

Pull Requests Commits

Update tests/fixtures.py

NathanHB committed 1 year ago

Verified b6678f96

Update .github/workflows/tests.yaml

NathanHB committed 1 year ago

Verified 1e14b054

expose secret to tests

hynky1999 committed 1 year ago

ef40c6cc

remove token from evaluation tracker

hynky1999 committed 1 year ago

3867c3fe

remove the overwriting hf test token

hynky1999 committed 1 year ago

2f3b7ba1

Merge branch 'logging_revamp' of github.com:huggingface/lighteval into logging_revamp

hynky1999 committed 1 year ago

b79af318

add import so that fixture is imported + hf token handilng

hynky1999 committed 1 year ago

476116ba

Merge branch 'logging_revamp' of github.com:huggingface/lighteval into logging_revamp

NathanHB committed 1 year ago

cfef3da5

fix tests by adding the HF TOKEN and importing fixture

NathanHB committed 1 year ago

72630347

Merge remote-tracking branch 'origin/main' into logging_revamp

hynky1999 committed 1 year ago

7f404736

Standalone nanotron config (#285)

hynky1999 committed 1 year ago

Verified aaa8bbf7

hynky1999 committed 1 year ago

db73c2c6

Merge branch 'main' into logging_revamp

hynky1999 committed 1 year ago

Verified 2a984601

improve fixtures

hynky1999 committed 1 year ago

ff84ae49

add vlmm backend (#274)

NathanHB committed 1 year ago

Verified 21934d52

NathanHB committed 1 year ago

3d26bbc4

Probability Metric + New Normalization (#276)

hynky1999 committed 1 year ago

Verified 8c787df2

Merge branch 'main' into logging_revamp

NathanHB committed 1 year ago

Verified 4ed3c19a

fix nanotron (#283)

NathanHB committed 1 year ago

Verified cdeb6c2d

fix tensorboard and push to hub args

NathanHB committed 1 year ago

8a8af5b1

add better comment to output_dir

hynky1999 committed 1 year ago

efb4ce86

add new deps to pyproject

hynky1999 committed 1 year ago

d1ea3708

revert the push to hub removal

hynky1999 committed 1 year ago

0892317c

Stashing changes to logging

hynky1999 committed 1 year ago

1a5fb7d9

Refactoring the few shot management (#272)

clefourrier committed 1 year ago

Verified 24adaa20

Example Configs and Docs (#255)

RohitMidha23 committed 1 year ago

Verified 8883a77f

Remove expensive prediction run during test collection (#279)

hynky1999 committed 1 year ago

Verified 357c75bf

make info loggers dataclass, so that their properties have expected lifetime (#280)

hynky1999 committed 1 year ago

Verified 52a12f98

Small file reorg (only renames/moves) (#271)

clefourrier committed 1 year ago

Verified e6b599a1

Programmatic interface + cleaner management of requests (#269)

clefourrier committed 1 year ago

Verified 9c82fdb8

Older