huggingface/lighteval

Pull Requests Commits

allow bette rmessage managment for litellm

NathanHB committed 362 days ago

78789c12

Fixed some bugs.

JoelNiklaus committed 362 days ago

ff6d5de9

Enabled passing through system prompt to the models in the requests.

JoelNiklaus committed 363 days ago

1a10351d

Merge branch 'main' into add_litellm_inference

JoelNiklaus committed 363 days ago

Verified cca1446a

Fix minor typos (#449)

albertvillanova committed 363 days ago

Verified 0ebc7ec0

Merge branch 'add_litellm_inference' of github.com:JoelNiklaus/lighteval into add_litellm_inference

NathanHB committed 363 days ago

2a238361

fix import location

NathanHB committed 363 days ago

45d6d1db

Merge branch 'main' into add_litellm_inference

NathanHB committed 363 days ago

Verified 8fc9b13d

Fix wrong instructions and code for custom tasks (#450)

albertvillanova committed 363 days ago

Verified 500632a0

Fixed import issues.

JoelNiklaus committed 1 year ago

932fd2c7

Merge branch 'main' into add_litellm_inference

JoelNiklaus committed 1 year ago

7c0856e0

Fix imports from model_config (#443)

albertvillanova committed 1 year ago

Verified 93a056fe

Fix custom arabic tasks (#440)

clefourrier committed 1 year ago

Verified 0135c2e6

Fix a tiny bug in `PromptManager::FewShotSampler::_init_fewshot_sampling_random` (#423)

sadra-barikbin committed 1 year ago

Verified ca2fdcbb

Allow AdapterModels to have custom tokens (#306)

mapmeld committed 1 year ago

Verified 54244b39

Test inference endpoint model config parsing from path (#434)

albertvillanova committed 1 year ago

Verified f907a343

Add new Arabic benchmarks (5) and enhance existing tasks (#372)

alielfilali01 committed 1 year ago

Verified de8dba39

Deprecate Obsolete Config Properties (#433)

ParagEkbote committed 1 year ago

Verified 6ad7276e

Fix ignored reuse_existing in config file (#431)

albertvillanova committed 1 year ago

Verified f2e1f697

Update docs about inference endpoints (#432)

albertvillanova committed 1 year ago

Verified 075a2660

Add trufflehog secrets detection (#429)

albertvillanova committed 1 year ago

Verified c0966cfd

add configs with their models (#421)

clefourrier committed 1 year ago

Verified 9315f0d4

Adds Global MLMU (#426)

hynky1999 committed 1 year ago

Verified 412ccfc1

Made configuration simpler.

JoelNiklaus committed 1 year ago

a2587d65

Revert weird change to __main__.py.

JoelNiklaus committed 1 year ago

ade8f0cf

Merge branch 'main' into add_litellm_inference

JoelNiklaus committed 1 year ago

Verified 20a11913

Fixed issues with stop_sequence, max_completion_tokens and system_prompt.

JoelNiklaus committed 1 year ago

47b18880

option to list custom tasks (#425)

NathanHB committed 1 year ago

Verified f2d0a65e

NathanHB committed 1 year ago

251e1815

Merge branch 'main' into add_litellm_inference

NathanHB committed 1 year ago

Verified ebdd9004

Older