huggingface/lighteval

Pull Requests Commits

add comment back

clefourrier committed 1 year ago

2c650c9c

Merge branch 'main' into adding_inference_endpoints

clefourrier committed 1 year ago

b13b3026

revert name + add import fix

clefourrier committed 1 year ago

827488ee

Update src/lighteval/models/base_model.py

clefourrier committed 1 year ago

Verified dc454fdc

Adding the target perplexity fix back (#15)

clefourrier committed 1 year ago

Verified 77eee8cb

pass 1 after code review

clefourrier committed 1 year ago

9b0fe549

Revert "moving custom tasks to code"

thomwolf committed 1 year ago

37db422f

moving custom tasks to code

thomwolf committed 1 year ago

cb163be1

fix test suite 2

clefourrier committed 1 year ago

cc1e7dd5

clefourrier committed 1 year ago

d9b262fa

wip, need to debug tests

clefourrier committed 1 year ago

e3cbe24b

clefourrier committed 1 year ago

5cfeb9a6

Merge branch 'main' into adding_inference_endpoints

clefourrier committed 1 year ago

203692a8

simplification part 1

clefourrier committed 1 year ago

e74ae0ad

finished making the endpoints work! héhé

clefourrier committed 1 year ago

1cd850b7

Documentation and typing of functions (#5)

NathanHB committed 1 year ago

Verified 059e100b

use requests in datasets

clefourrier committed 1 year ago

35830716

Revert "Merge pull request #10 from huggingface/fix-target-perplexity" (#14)

NathanHB committed 1 year ago

Verified c50e19f6

endpoints must be lowercase, added a timeout

clefourrier committed 1 year ago

eb282080

add configs + main launcher

clefourrier committed 1 year ago

60759553

clefourrier committed 1 year ago

601ac95f

add base model + wrap up inference endpoint model

clefourrier committed 1 year ago

9579f9e7

Merge pull request #10 from huggingface/fix-target-perplexity

thomwolf committed 1 year ago

Verified 19257428

thomwolf committed 1 year ago

ae084747

Merge branch 'fix-target-perplexity' of https://github.com/huggingface/lighteval into fix-target-perplexity

thomwolf committed 1 year ago

15d14c90

clefourrier committed 1 year ago

246b581e

clefourrier committed 1 year ago

50c18f93

fix target perplexity

clefourrier committed 1 year ago

7ab2295f

clefourrier committed 1 year ago

8e95e0fc

thomwolf committed 1 year ago

28ec9263

Older