PR #12 Adding inference endpoints models

Adding inference endpoints models #12

clefourrier merged 18 commits into main from adding_inference_endpoints

wip

246b581e

add base model + wrap up inference endpoint model

9579f9e7

added config

601ac95f

add configs + main launcher

60759553

endpoints must be lowercase, added a timeout

eb282080

use requests in datasets

35830716

finished making the endpoints work! héhé

1cd850b7

simplification part 1

e74ae0ad

Merge branch 'main' into adding_inference_endpoints

203692a8

fix model type

5cfeb9a6

wip, need to debug tests

e3cbe24b

fix suite 1

d9b262fa

fix test suite 2

cc1e7dd5

clefourrier requested a review from

NathanHB 1 year ago

NathanHB commented on 2024-02-07

pass 1 after code review

9b0fe549

Update src/lighteval/models/base_model.py

dc454fdc

revert name + add import fix

827488ee

Merge branch 'main' into adding_inference_endpoints

b13b3026

add comment back

2c650c9c

NathanHB approved these changes on 2024-02-07

clefourrier merged 1e837a97 into main 1 year ago

Reviewers

NathanHB

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

lighteval Adding inference endpoints models #12 Merged

Adding inference endpoints models #12

lighteval
Adding inference endpoints models
#12

Merged