PR #926 Parametrizing the sampling evals from the CLI

defined a sampling type for metrics, works for cli, now needs to port all old evals to the new format and figure out how to provide sane defaults

clefourrier committed 234 days ago

rm useless case

clefourrier committed 234 days ago

updated tests

clefourrier committed 234 days ago

fix test

clefourrier committed 233 days ago

added conversion for normalizations

clefourrier committed 233 days ago

first pass transforming Hynek's metric functions into classes like they should have been

clefourrier committed 233 days ago

imports

clefourrier committed 233 days ago

removed single token evals since we no longer have the feature, added a name update with parameter change

clefourrier committed 233 days ago

keep on making metrics more adjustable

clefourrier committed 233 days ago

updating test suite given the new names

clefourrier committed 233 days ago

manual update of file

clefourrier committed 233 days ago

manual update of file

clefourrier committed 233 days ago

fix mcc single token

clefourrier committed 233 days ago

now metrics are em

clefourrier committed 233 days ago

some fixs for tests

clefourrier committed 233 days ago

rm trivia qa outdated

clefourrier committed 233 days ago

removed dumdum enum overwrite

clefourrier committed 233 days ago

fix test

clefourrier committed 233 days ago

rm a space

clefourrier committed 233 days ago

cleaner loop

clefourrier committed 233 days ago

test

clefourrier committed 233 days ago

better json encoder + a small naming fix