adding closed source models
8bda6bb6
refacto CLI
8122fb87
use correct parallelism manager for each model we use
8e6e6152
adds typer
e85d31ad
adds typer
f6e18e8a
use typer as cli tool
372b89bc
redo logging
94031db5
redo logging
8c7f67cf
lazy load rouge scorer
c18f1bea
fixes
4960dd59
change log level of missing task
a3ac7a3d
remove unused variable
00f39624
fixes
1360abe8
fix from review
e99c2687
Merge branch 'main' into nathan-refacto-cli
85d2ef06
remove uneeded files
e9508284
Merge branch 'nathan-refacto-cli' of github.com:huggingface/lighteval…
7864c6b2
add typer to deps
f989ed82
fix docs
2c2748ca
fix docs
a80a1dbb
fix docs
ae4cabaa
fix tests
a79453ab
fix tests
34815626
fix tests
b0ca7f13
fix tests
39ba2826
Update src/lighteval/metrics/metrics_sample.py
9110d96d
Merge branch 'nathan-refacto-cli' into nathan-refacto-logging
39d70a53
Merge branch 'nathan-refacto-logging' of github.com:huggingface/light…
7b9ab209
Update src/lighteval/metrics/metrics_sample.py
7339568b
NathanHB
changed the base branch from
nathan-refacto-cli
to
main
1 year ago
Merge remote-tracking branch 'origin/main' into nathan-refacto-logging
6ef4e810
fix dependencies
5280fc0f
rm hirarchical logger file
1c30decc
fix logging level
38ce2911
fix readme
4a1b94a3
fix dependencies and readme
2e55920c
Update src/lighteval/pipeline.py
c96c6ca0
Update src/lighteval/tasks/registry.py
051f5e27
Merge branch 'main' into nathan-refacto-logging
aac6c82b
fix styling
f1013bbf
NathanHB
merged
1fb79686
into main 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub