Add litellm inference #385
NathanHB
merged
50 commits into
huggingface:main
from
JoelNiklaus:add_litellm_inference
Added inference using litellm.
17783b24
Add Udmurt (udm) translation literals (#381)
9e92150c
This PR adds translation literals for Belarusian language. (#382)
30a624c2
fix: cache directory variable (#378)
6e6fed65
greedy_until() fix (#344)
d1d4c694
Fixed some params in completion call to enable more model providers.
f69811fd
Added diskcache.
dabb4a7f
NathanHB
commented
on 2024-11-19
NathanHB
commented
on 2024-11-19
Merge branch 'main' into add_litellm_inference
65f759c5
Merge branch 'main' into add_litellm_inference
f74afd4c
Fix issue for openai evaluation.
88a98382
Added support for stop sequences and generation size.
02ed4616
Merge branch 'main' into add_litellm_inference
34596c27
Fixed issue with too many concurrent calls to APIs.
190738f1
Merge branch 'main' into add_litellm_inference
2bb19177
Merge branch 'main' into add_litellm_inference
81e44048
Merge branch 'main' into add_litellm_inference
ebdd9004
few fixes
251e1815
JoelNiklaus
commented
on 2024-12-06
Fixed issues with stop_sequence, max_completion_tokens and system_pro…
47b18880
Merge branch 'main' into add_litellm_inference
20a11913
Revert weird change to __main__.py.
ade8f0cf
Made configuration simpler.
a2587d65
Merge branch 'main' into add_litellm_inference
7c0856e0
Fixed import issues.
932fd2c7
NathanHB
approved these changes
on 2024-12-16
Merge branch 'main' into add_litellm_inference
8fc9b13d
fix import location
45d6d1db
Merge branch 'add_litellm_inference' of github.com:JoelNiklaus/lighte…
2a238361
Merge branch 'main' into add_litellm_inference
cca1446a
Enabled passing through system prompt to the models in the requests.
1a10351d
Fixed some bugs.
ff6d5de9
Merge branch 'main' into add_litellm_inference
8d831b8e
Made litellm inference robust to content management errors.
51154031
allow bette rmessage managment for litellm
78789c12
Merge branch 'main' into add_litellm_inference
3ebff6cb
allow system prompt to be passed to litellm models
be77b15b
Merge branch 'main' into add_litellm_inference
21d6112c
clefourrier
commented
on 2024-12-18
use system prompt from the request and use litellm encode functino as…
d045d92e
fixes from review
f1ed6826
Merge branch 'add_litellm_inference' of github.com:JoelNiklaus/lighte…
ec306fda
fix tests
bae45063
fix tests
6b0cb60e
Merge branch 'main' into add_litellm_inference
c826b0ef
remove unecessary doc
a6747f4f
Merge branch 'add_litellm_inference' of github.com:JoelNiklaus/lighte…
55547873
albertvillanova
commented
on 2024-12-19
albertvillanova
commented
on 2024-12-19
Update src/lighteval/models/litellm_model.py
5b2b72d8
Update src/lighteval/models/litellm_model.py
0265a74f
Merge branch 'main' into add_litellm_inference
4fa83111
Support retrying of empty cached model responses.
86dd849c
Merge branch 'main' into add_litellm_inference
db983e34
Fixed error when stop sequence is None.
221d5d5d
Added support for litellm as judge backend.
81f02cab
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub