huggingface/lighteval

Pull Requests Commits

add comment back

clefourrier committed 2 years ago

2c650c9c

Merge branch 'main' into adding_inference_endpoints

clefourrier committed 2 years ago

b13b3026

revert name + add import fix

clefourrier committed 2 years ago

827488ee

Update src/lighteval/models/base_model.py

clefourrier committed 2 years ago

Verified dc454fdc

Adding the target perplexity fix back (#15)

clefourrier committed 2 years ago

Verified 77eee8cb

pass 1 after code review

clefourrier committed 2 years ago

9b0fe549

Revert "moving custom tasks to code"

thomwolf committed 2 years ago

37db422f

moving custom tasks to code

thomwolf committed 2 years ago

cb163be1

fix test suite 2

clefourrier committed 2 years ago

cc1e7dd5

clefourrier committed 2 years ago

d9b262fa

wip, need to debug tests

clefourrier committed 2 years ago

e3cbe24b

clefourrier committed 2 years ago

5cfeb9a6

Merge branch 'main' into adding_inference_endpoints

clefourrier committed 2 years ago

203692a8

simplification part 1

clefourrier committed 2 years ago

e74ae0ad

finished making the endpoints work! héhé

clefourrier committed 2 years ago

1cd850b7

Documentation and typing of functions (#5)

NathanHB committed 2 years ago

Verified 059e100b

use requests in datasets

clefourrier committed 2 years ago

35830716

Revert "Merge pull request #10 from huggingface/fix-target-perplexity" (#14)

NathanHB committed 2 years ago

Verified c50e19f6

endpoints must be lowercase, added a timeout

clefourrier committed 2 years ago

eb282080

add configs + main launcher

clefourrier committed 2 years ago

60759553

clefourrier committed 2 years ago

601ac95f

add base model + wrap up inference endpoint model

clefourrier committed 2 years ago

9579f9e7

Merge pull request #10 from huggingface/fix-target-perplexity

thomwolf committed 2 years ago

Verified 19257428

thomwolf committed 2 years ago

ae084747

Merge branch 'fix-target-perplexity' of https://github.com/huggingface/lighteval into fix-target-perplexity

thomwolf committed 2 years ago

15d14c90

clefourrier committed 2 years ago

246b581e

clefourrier committed 2 years ago

50c18f93

fix target perplexity

clefourrier committed 2 years ago

7ab2295f

clefourrier committed 2 years ago

8e95e0fc

thomwolf committed 2 years ago

28ec9263

Older