lighteval
Integrate huggingface_hub inference support
#651
Merged

Integrate huggingface_hub inference support #651

alozowski merged 11 commits into main from improve-llm-as-judge
alozowski
alozowski Integrate huggingface_hub inference support
ddccc660
alozowski alozowski requested a review from NathanHB NathanHB 266 days ago
HuggingFaceDocBuilderDev
alozowski Apply Ruff to llm_as_judge.py and metrics_sample.py
6bd7af79
alozowski Apply Ruff to llm_as_judge.py
0a84f041
alozowski base_url fix in metrics_sample.py
a645f3f3
clefourrier
clefourrier commented on 2025-03-28
clefourrier
alozowski Rename hf-inference to inference-providers
d0e4a543
alozowski Add validation for inference-providers backend configuration
9aa02c86
alozowski Restore lazy loading of transformers imports in //metrics/llm_as_judg…
3f5ad7b3
alozowski Change back base_url to url in /metrics/metrics_sample.py
d9a47cec
alozowski Fix logger messages in /metrics/metrics_sample.py
24384793
alozowski Change default value for max_tokens llm_as_judge.py
0ebde9cb
alozowski Apply Ruff to llm_as_judge.py
85f1dd11
clefourrier
clefourrier approved these changes on 2025-03-31
alozowski alozowski merged e611a91f into main 262 days ago
NathanHB NathanHB added feature

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone