Exporting Evaluation Results from Arize for Analysis

·Oct 03, 2024 04:48 PM

Hi all, we are currently running experiments with Arize using a golden benchmarking dataset. Once we have the results in Arize, is there a way to export the dataset + eval results? I know Phoenix you can persist an SQLite db, is there a way to get the results back out of Arize in that form? Or csv? The reason I ask is we need to filter the results, graph different metrics over time, in addition to some basic analytics that I don't believe is possible in Arize (the only capability we have I think is to plot the eval results for the last 10 experiments, but that range can't be changed?). Thanks

2 comments

· Sorted by Oldest

John G.
·
Hey Simon W. sorry for the delay here! We have a get_experiment method that can retrieve those experiment results. Docs on that here That would give you granular data on each example and its evaluation results as a dataframe. You're right that we don't support changing the range and metrics in the UI now. Does that get_experiment method work for what you're trying to do?
👍1
Simon W.
·
That’s what I was looking for, thank you!

John G.
·
Hey Simon W. sorry for the delay here! We have a get_experiment method that can retrieve those experiment results. Docs on that here That would give you granular data on each example and its evaluation results as a dataframe. You're right that we don't support changing the range and metrics in the UI now. Does that get_experiment method work for what you're trying to do?
👍1
Simon W.
·
That’s what I was looking for, thank you!