huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into task_config

hynky1999 committed 1 year ago

Verified 1bd726a1

remove redudant check

Hynek Kydlicek committed 1 year ago

f9510970

Tokenization-wise encoding (#287)

hynky1999 committed 1 year ago

Verified 5034a962

Merge branch 'main' into task_config

hynky1999 committed 1 year ago

Verified 0d52a555

bump dev version to 0.5.0 (#291)

NathanHB committed 1 year ago

Verified 7261d80d

bump nltk version (#290)

NathanHB committed 1 year ago

Verified 279a9f2a

Merge branch 'main' into task_config

hynky1999 committed 1 year ago

Verified 0919229d

hynky1999 committed 1 year ago

a732e974

hynky1999 committed 1 year ago

ec20534f

add tests for filtering/revision

hynky1999 committed 1 year ago

c51a7626

Logging Revamp (#284)

hynky1999 committed 1 year ago

Verified e0af8215

connect datatasert revision and filter

hynky1999 committed 1 year ago

10870a6a

clean up task/config

hynky1999 committed 1 year ago

9427818c

add new params to config class

hynky1999 committed 1 year ago

9f003ffd

Standalone nanotron config (#285)

hynky1999 committed 1 year ago

Verified aaa8bbf7

add vlmm backend (#274)

NathanHB committed 1 year ago

Verified 21934d52

Probability Metric + New Normalization (#276)

hynky1999 committed 1 year ago

Verified 8c787df2

fix nanotron (#283)

NathanHB committed 1 year ago

Verified cdeb6c2d

Refactoring the few shot management (#272)

clefourrier committed 1 year ago

Verified 24adaa20

Example Configs and Docs (#255)

RohitMidha23 committed 1 year ago

Verified 8883a77f

Remove expensive prediction run during test collection (#279)

hynky1999 committed 1 year ago

Verified 357c75bf

make info loggers dataclass, so that their properties have expected lifetime (#280)

hynky1999 committed 1 year ago

Verified 52a12f98

Small file reorg (only renames/moves) (#271)

clefourrier committed 1 year ago

Verified e6b599a1

Programmatic interface + cleaner management of requests (#269)

clefourrier committed 1 year ago

Verified 9c82fdb8

Add grammar option to generation (#242)

sadra-barikbin committed 1 year ago

Verified e43c9490

updates ifeval repo (#268)

NathanHB committed 1 year ago

Verified cf87de99

fix the location of tasks list in the readme (#267)

NathanHB committed 1 year ago

Verified 194e742f

change priority when choosing model dtype (#263)

NathanHB committed 1 year ago

Verified 5c1ae855

Fix missing json file (#264)

NathanHB committed 1 year ago

Verified 01a5129f

A small improvement in `metrics_sample.py::ROUGE` (#217)

sadra-barikbin committed 1 year ago

Verified b54c1896

Older