John W.

Nate

Thanks nate.

Any thoughts?

I ran the get_evaluations and got this:

[SpanEvaluations(eval_name='Hallucination', id=UUID('a4a9fe26-1074-44ea-bf73-3ccaf46b29ff')),
 SpanEvaluations(eval_name='QA Correctness', id=UUID('3cb86402-b7b9-435c-993b-e81da02b2af5')),
 DocumentEvaluations(eval_name='Relevance', id=UUID('168ebcf4-69ba-44a5-be36-50091a68a482'))]

How would I retrieve the actual data from the specific evaluation? TIA.

Thanks again... I'm experimenting with different methods of loading markdown into a RAG using Langchain. I've written simple benchmarks for all different methods of the data ingest process. I'm comparing the RAGs' built-in similarity scores to Arize's metrics to try and predict what will be the best method.

That worked great for me. However, I want to get the metrics of ndcg, precision, hit rate, qa correctness as well as the hallucination and evaluation data. TIA.