Querying Tracing Topology: DSL Overview and Evaluation Tips

Hey Francisco S. we have a pretty extensive query DSL that helps you query and join the tracing topology. https://docs.arize.com/phoenix/tracing/how-to-tracing/extract-data-from-spans We also have some convenience queries that retrieve documents under a trace and join it back to the root query. This query doesn’t work for every RAG case (sub document queries notably) but it does work for “simple” RAG (Langchain included) You can also just pull the spans and use Pandas to construct data to run evals or annotations on The evaluations can be attached to any level of a trace - to spans and even documents within a retrieval step so it’s customizable https://docs.arize.com/phoenix/tracing/how-to-tracing/llm-evaluations Were also releasing datasets shortly so you will be able to query for retriever spans, and add them to a dataset for later evaluation or analysis Hope that helps