PR #909 Caching samples PR

Caching samples PR #909

clefourrier merged 17 commits into main from test_caching

init

e0cd1330

not working

aaae0ea2

Merge branch 'main' into test_caching

76c8b6e8

added caching to transformers

39c03e7c

fixed caching system for predictions, and better logging

205ab1e5

Merge branch 'main' into test_caching

187aaa72

cache management is working well with no DP for accelerate - need to …

03eb193c

we now actively load cached samples after processing the needed items

94e31f18

removed loglikelihood single tokens since it was removed everywhere i…

3a9d1fbe

remove useless parameter

ba776ab8

cleanup, some things hanging when being removed from the refacto - no…

19fa6d13

wip tests

348b7d23

we separate the interface function from the actual logic in models, a…

d2ff97c0

clefourrier changed the title ~~Caching samples PR (ongoing)~~ Caching samples PR 126 days ago

Merge branch 'main' into test_caching

f4d5b145

clefourrier commented on 2025-08-11

added doc page to tree

730f226a

we mock iep model creation

35b7e94e

clefourrier force pushed from 8da1750a to 35b7e94e 126 days ago

clefourrier requested a review from

NathanHB 126 days ago

fix tests

ce0015e2

clefourrier merged df3a82d9 into main 126 days ago

NathanHB added feature

Reviewers

NathanHB

Assignees

No one assigned

Labels

feature

Milestone

No milestone

lighteval Caching samples PR #909 Merged

Caching samples PR #909

lighteval
Caching samples PR
#909

Merged