huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

4319230b

clefourrier committed 1 year ago

7a54afa1

fix model parallel (#481)

NathanHB committed 1 year ago

Verified 24afde29

Merge branch 'main' into clem_homogeneize_generation_params

NathanHB committed 1 year ago

Verified c0566eed

Add litellm inference (#385)

JoelNiklaus committed 1 year ago

Verified a2541b12

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

Verified fddfa6f4

fix: scorer attribute initialization in ROUGE (#471)

ryan-minato committed 1 year ago

Verified 2ef9740d

fix: LightevalTaskConfig.stop_sequence attribute (#463)

ryan-minato committed 1 year ago

Verified 9ff194d1

Delete endpoint on InferenceEndpointTimeoutError (#475)

albertvillanova committed 1 year ago

Verified 801c21a1

clefourrier committed 1 year ago

ded4cf0f

clefourrier committed 1 year ago

e636f739

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

Verified e2d512be

inferenceendpoint renamed to ie

clefourrier committed 1 year ago

97db6203

Update src/lighteval/models/transformers/transformers_model.py

clefourrier committed 1 year ago

Verified e233190e

clefourrier committed 1 year ago

843b572f

added from path to openai model

clefourrier committed 1 year ago

3f96b954

clefourrier committed 1 year ago

87d052ce

Apply suggestions from code review

clefourrier committed 1 year ago

Verified ff5026b1

Checkout PR merge commit for CI tests (#468)

albertvillanova committed 1 year ago

Verified 8568e725

Fix warning about precedence of custom tasks over default ones in registry (#466)

albertvillanova committed 1 year ago

Verified 264f3f89

Update arabic_evals.py: Fix custom arabic tasks [2nd attempt] (#444)

alielfilali01 committed 1 year ago

Verified fbca1436

Remove unnecessary deepcopy in evaluation_tracker (#459)

albertvillanova committed 1 year ago

Verified a1c610da

Add EvaluationTracker to docs and fix its docstring (#464)

albertvillanova committed 1 year ago

Verified 988fa94d

fix: CACHE_DIR Default Value in Accelerate Pipeline (#461)

ryan-minato committed 1 year ago

Verified c45e3c8b

added default gen params

clefourrier committed 1 year ago

90593a96

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

Verified c6f42cad

Upgrade deprecated GH Action cache@v2 (#456)

albertvillanova committed 1 year ago

Verified 0977fde6

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

Verified 83cbb10a

clefourrier committed 1 year ago

6a18b812

Update src/lighteval/models/transformers/transformers_model.py

clefourrier committed 1 year ago

Verified 5c89fe25

Older