benchmark
c03fa7c6 - Handle accuracy results in benchmark records (#143611)

Commit
1 year ago
Handle accuracy results in benchmark records (#143611) Summary: I discovered this issue when trying to search for the accuracy results on the database and couldn't find any. It turns out that the results is there on the JSON file, for example `"metric": {"name": "accuracy", "benchmark_values": ["pass_due_to_skip"]}`, but inserting them into the database fails because benchmark values is a list of strings here while the expectation is that it's a list of numbers. ClickHouse doesn't support mix types atm. It has a Variant type https://clickhouse.com/docs/en/sql-reference/data-types/variant, but this isn't recommended by CH team themselves. So, the remaining option is to store this in the `extra_info` field. This field is a dictionary, so it can goes there. ### Testing https://github.com/pytorch/pytorch/actions/runs/12421747715 X-link: https://github.com/pytorch/pytorch/pull/143611 Approved by: https://github.com/kit1980 Reviewed By: atalman Differential Revision: D67506703 Pulled By: huydhn fbshipit-source-id: b7211dc1e455b51d7880e6566651f88f32e03c54
Author
Parents
Loading