lighteval
1dfd77d1 - Fix Tokenization + misc fixes (#354)

Commit
1 year ago
Fix Tokenization + misc fixes (#354) * fix loggers with multimetric, fix pariwise tokenization + fallback for non-pairwise, add pairwise to vllm, use multiprocess fordataset loading * fix test + implementation * finally do the tokenization correctly * pair_wise -> pairwise --------- Co-authored-by: Nathan Habib <30601243+NathanHB@users.noreply.github.com>
Author
Parents
Loading