huggingface/lighteval

Pull Requests Commits

remove unescerary print

NathanHB committed 1 year ago

b756f4c0

NathanHB committed 1 year ago

ed7b35d9

Merge branch 'main' into nathan-vllm-backend

NathanHB committed 1 year ago

Verified 1b57b260

NathanHB committed 1 year ago

b52239db

NathanHB committed 1 year ago

fe8da513

Probability Metric + New Normalization (#276)

hynky1999 committed 1 year ago

Verified 8c787df2

NathanHB committed 1 year ago

97632d9a

NathanHB committed 1 year ago

d0b46e9a

NathanHB committed 1 year ago

5c9029c4

NathanHB committed 1 year ago

9029943c

fix from review

NathanHB committed 1 year ago

8b2392aa

fix nanotron (#283)

NathanHB committed 1 year ago

Verified cdeb6c2d

Merge branch 'nathan-vllm-backend' of github.com:huggingface/lighteval into nathan-vllm-backend

NathanHB committed 1 year ago

6dc35c6b

Update src/lighteval/models/model_config.py

NathanHB committed 1 year ago

Verified 0a66f408

Refactoring the few shot management (#272)

clefourrier committed 1 year ago

Verified 24adaa20

Example Configs and Docs (#255)

RohitMidha23 committed 1 year ago

Verified 8883a77f

Remove expensive prediction run during test collection (#279)

hynky1999 committed 1 year ago

Verified 357c75bf

add vlmm backend

NathanHB committed 1 year ago

ea0cd3d2

make info loggers dataclass, so that their properties have expected lifetime (#280)

hynky1999 committed 1 year ago

Verified 52a12f98

Small file reorg (only renames/moves) (#271)

clefourrier committed 1 year ago

Verified e6b599a1

Programmatic interface + cleaner management of requests (#269)

clefourrier committed 1 year ago

Verified 9c82fdb8

add vlmm backend

NathanHB committed 1 year ago

06ead43d

Add grammar option to generation (#242)

sadra-barikbin committed 1 year ago

Verified e43c9490

updates ifeval repo (#268)

NathanHB committed 1 year ago

Verified cf87de99

fix the location of tasks list in the readme (#267)

NathanHB committed 1 year ago

Verified 194e742f

change priority when choosing model dtype (#263)

NathanHB committed 1 year ago

Verified 5c1ae855

Fix missing json file (#264)

NathanHB committed 1 year ago

Verified 01a5129f

A small improvement in `metrics_sample.py::ROUGE` (#217)

sadra-barikbin committed 1 year ago

Verified b54c1896

adds llm as judge using transformers (#223)

NathanHB committed 1 year ago

Verified cb32024d

Fix IFEval metric (#259)

lewtun committed 1 year ago

Verified 38c03ad2

Older