lighteval

03eb193c - cache management is working well with no DP for accelerate - need to 1)test with DP 2) add a system where we load cached samples in mem *after* processing the other items