lighteval
f3639c67 - Use `n=16` samples to estimate `pass@1` for AIME benchmarks (#661)

Commit

327 days ago

Use `n=16` samples to estimate `pass@1` for AIME benchmarks (#661) * Use n=16 samples to estimate pass@1 for AIME benchmarks * Remove other metrics

References

Author

lewtun

Parents