huggingface/lighteval

Pull Requests Commits

allow bette rmessage managment for litellm

NathanHB committed 1 year ago

78789c12

Fixed some bugs.

JoelNiklaus committed 1 year ago

ff6d5de9

Enabled passing through system prompt to the models in the requests.

JoelNiklaus committed 1 year ago

1a10351d

Merge branch 'main' into add_litellm_inference

JoelNiklaus committed 1 year ago

Verified cca1446a

Fix minor typos (#449)

albertvillanova committed 1 year ago

Verified 0ebc7ec0

Merge branch 'add_litellm_inference' of github.com:JoelNiklaus/lighteval into add_litellm_inference

NathanHB committed 1 year ago

2a238361

fix import location

NathanHB committed 1 year ago

45d6d1db

Merge branch 'main' into add_litellm_inference

NathanHB committed 1 year ago

Verified 8fc9b13d

Fix wrong instructions and code for custom tasks (#450)

albertvillanova committed 1 year ago

Verified 500632a0

Fixed import issues.

JoelNiklaus committed 1 year ago

932fd2c7

Merge branch 'main' into add_litellm_inference

JoelNiklaus committed 1 year ago

7c0856e0

Fix imports from model_config (#443)

albertvillanova committed 1 year ago

Verified 93a056fe

Fix custom arabic tasks (#440)

clefourrier committed 1 year ago

Verified 0135c2e6

Fix a tiny bug in `PromptManager::FewShotSampler::_init_fewshot_sampling_random` (#423)

sadra-barikbin committed 1 year ago

Verified ca2fdcbb

Allow AdapterModels to have custom tokens (#306)

mapmeld committed 1 year ago

Verified 54244b39

Test inference endpoint model config parsing from path (#434)

albertvillanova committed 1 year ago

Verified f907a343

Add new Arabic benchmarks (5) and enhance existing tasks (#372)

alielfilali01 committed 1 year ago

Verified de8dba39

Deprecate Obsolete Config Properties (#433)

ParagEkbote committed 1 year ago

Verified 6ad7276e

Fix ignored reuse_existing in config file (#431)

albertvillanova committed 1 year ago

Verified f2e1f697

Update docs about inference endpoints (#432)

albertvillanova committed 1 year ago

Verified 075a2660

Add trufflehog secrets detection (#429)

albertvillanova committed 1 year ago

Verified c0966cfd

add configs with their models (#421)

clefourrier committed 1 year ago

Verified 9315f0d4

Adds Global MLMU (#426)

hynky1999 committed 1 year ago

Verified 412ccfc1

Made configuration simpler.

JoelNiklaus committed 1 year ago

a2587d65

Revert weird change to __main__.py.

JoelNiklaus committed 1 year ago

ade8f0cf

Merge branch 'main' into add_litellm_inference

JoelNiklaus committed 1 year ago

Verified 20a11913

Fixed issues with stop_sequence, max_completion_tokens and system_prompt.

JoelNiklaus committed 1 year ago

47b18880

option to list custom tasks (#425)

NathanHB committed 1 year ago

Verified f2d0a65e

NathanHB committed 1 year ago

251e1815

Merge branch 'main' into add_litellm_inference

NathanHB committed 1 year ago

Verified ebdd9004

Older