With a trace like this, is it possible to annotate individual documents? The docs suggest so here (https://arize.com/docs/phoenix/tracing/concepts-tracing/annotations-concepts#annotation-targets):
Document Annotations: Specifically for retrieval systems, evaluating individual documents with metrics like relevance and precision
But I don’t see how it’s possible in the UI.
💡 Hint: Mention RunLLM in the thread for followups.
yes. are there plans to support this in the UI?
💡 Hint: Mention RunLLM in the thread for followups.
hey Andrew S. this is probably not that hard given the state of AI these days. Can you give us a bit more of the type of annotations you'd want to add. Are they basically relevance per document? You need multiple annotations per document? I'll fire off an agent to work - just need to better understand what UX you'd like
Right now it’s simply evaluating precision and recall for retrieval. So false negative/false positive with an optional note is all I really need at the moment. https://www.loom.com/share/b4c322552955434a9059c17e22438e30
