Manual Evaluation of Datasets: Instructions and Example Files
Running Manual Evaluations with Datasets Hi team! What if I want to run evaluations manually, and I have the following files:
dataset.tsv
query.tsv
label.tsv
Example: label.tsv:
id query_id product_id label
0 0 1 Exact
1 0 2 Irrelevant
2 0 3 Exactdataset.tsv:
product_id product_name product_class product_description
1 Hello World T-Shirt Clothing A simple t-shirt with "Hello World" printed on it.
2 Hello World Mug Kitchenware A mug with "Hello World" written on it.
3 Hello World Poster Wall Art A poster that says "Hello World".query.tsv:
query_id query query_class
0 Hello World Clothing
1 Hello World Kitchenware
2 Hello World Wall ArtIs there a way to manually run evaluations using these datasets?
