huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into fix-math-chat

clefourrier committed 1 year ago

869ad787

fix test, separate math and math cot

clefourrier committed 1 year ago

f6f50092

clefourrier committed 1 year ago

63eeca7b

adding aimo custom eval (#154)

NathanHB committed 1 year ago

Verified 9e3078eb

Add version config option. (#181)

PhilipMay committed 1 year ago

Verified c89b386e

Fix prompt formatting

lewtun committed 1 year ago

c232d8df

Merge branch 'main' into fix-math-chat

clefourrier committed 1 year ago

Verified 7f80b211

Fix broken link to extended tasks in README (#182)

alexrs committed 1 year ago

Verified 979359db

Fix citation section in readme (#180)

NathanHB committed 1 year ago

Verified 6183bf22

Add maj@k metric (#158)

clefourrier committed 1 year ago

Verified 0a455c4f

add 'cite as' section in readme (#178)

NathanHB committed 1 year ago

Verified 98060932

Fix prompt format german rag community task (#171)

jphme committed 1 year ago

Verified af35e886

Merge branch 'main' into fix-math-chat

lewtun committed 1 year ago

Verified fe416488

better stop token managment when using chat templates

Nathan Habib committed 1 year ago

34b7595a

Fix _remove_right_units

lewtun committed 1 year ago

9195769d

no function we actually use should be named prompt_fn (#168)

clefourrier committed 1 year ago

Verified 11b48333

Handle case when text is None

lewtun committed 1 year ago

a5b4fd77

Merge branch 'main' into fix-math-chat

lewtun committed 1 year ago

a9009cda

Use same normaliser for predictions and golds

lewtun committed 1 year ago

ea368dab

Fix generation for chat models

lewtun committed 1 year ago

726acfbf

[MATH] Fix MATH normalization (#162)

lewtun committed 1 year ago

Verified fc428f60

lewtun committed 1 year ago

8a3cbe06

lewtun committed 1 year ago

12c3fb66

lewtun committed 1 year ago

a8fa3f56

Fix _fix_fracs in MATH normalization

lewtun committed 1 year ago

98c41c65

Nathan add logging to metrics (#157)

NathanHB committed 1 year ago

Verified 6a48e4e7

Fix nanotron models input size bug (#156)

clefourrier committed 1 year ago

Verified 6ea07cd7

CLI list tasks (#142)

DimbyTa committed 1 year ago

Verified f28a270a

Add llm as judge in metrics (#146)

NathanHB committed 1 year ago

Verified 7f6f8077

Added Namespace parameter for InferenceEndpoints, added option for passing model config directly (#147)

shaltielshmid committed 1 year ago

Verified 23987aa7

Older