PR #428 Homogeneize generation params

Homogeneize generation params #428

clefourrier merged 44 commits into main from clem_homogeneize_generation_params

clefourrier changed the base branch from main to refacto_model 1 year ago

clefourrier changed the base branch from refacto_model to main 1 year ago

adding input generation config

1ff5a783

added tgi model

12c6a909

grammar is task dependant, removed from the cofnig

c9657d29

added openai config + moved everything to dict

ac6565ad

added generation configs to models

2628571b

added generation configs to models

c24bf9b7

fix

0aa2e194

fix

e3311bde

added doc

a3f535f0

Saved GenerationParameter class in model config classes, then saved i…

286668ff

clefourrier force pushed from 071d5022 to 286668ff 1 year ago

changed model args

0b2475a1

test

521559f7

Merge branch 'main' into clem_homogeneize_generation_params

91363fea

updated launchers

c088ab67

Merge branch 'main' into clem_homogeneize_generation_params

e1bd34fb

rename base_model to transformers_model

3eb7d0ff

removed the use of a GenerationConfig object, as it's got lots of par…

a585701c

revert

f9ab29b8

fix docs

48339297

fix #16 by also allowing a generationconfig object to be passed progr…

30bed896

Merge branch 'main' into clem_homogeneize_generation_params

431b4f27

clefourrier requested a review from

NathanHB 1 year ago

albertvillanova commented on 2024-12-13

NathanHB commented on 2024-12-16

Apply suggestions from code review

fb4ecdc6

NathanHB commented on 2024-12-16

Update src/lighteval/models/transformers/transformers_model.py

be99c5ed

Merge branch 'main' into clem_homogeneize_generation_params

e8b90579

removed temperature from default vllm params as it should be passed v…

dece2f9b

Merge branch 'main' into clem_homogeneize_generation_params

8e3b7e2e

Update src/lighteval/models/transformers/transformers_model.py

5c89fe25

logging fix

6a18b812

Merge branch 'main' into clem_homogeneize_generation_params

83cbb10a

Merge branch 'main' into clem_homogeneize_generation_params

c6f42cad

added default gen params

90593a96

clefourrier requested a review from

NathanHB 1 year ago

NathanHB requested changes on 2024-12-18

albertvillanova commented on 2024-12-18

Apply suggestions from code review

ff5026b1

rename file

87d052ce

added from path to openai model

3f96b954

style

843b572f

Update src/lighteval/models/transformers/transformers_model.py

e233190e

inferenceendpoint renamed to ie

97db6203

Merge branch 'main' into clem_homogeneize_generation_params

e2d512be

style 2

e636f739

fix vllm

ded4cf0f

clefourrier requested a review from

NathanHB 1 year ago

Merge branch 'main' into clem_homogeneize_generation_params

fddfa6f4

Merge branch 'main' into clem_homogeneize_generation_params

c0566eed

NathanHB approved these changes on 2025-01-02

restore line

7a54afa1

Merge branch 'main' into clem_homogeneize_generation_params

4319230b

clefourrier merged 5a28b229 into main 1 year ago

Reviewers

NathanHB

albertvillanova

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

lighteval Homogeneize generation params #428 Merged

Homogeneize generation params #428

lighteval
Homogeneize generation params
#428

Merged