Hi everyone, is there a way to edit the columns in the annotations view? I want to add custom columns — they are being sent correctly, but I can’t see them in the UI.
Phoenix does not currently support adding fully custom columns to the annotations view in the UI; only configured annotation types (categorical, continuous, freeform) and certain metadata (like user, source, etc.) are supported as columns. Custom attributes or metadata sent with annotations (e.g., arbitrary keys) are not automatically rendered as new columns in the UI, though they may be stored and accessible via API or export functions. See Annotating in the UI and related GitHub issues.You can configure which annotation types appear as columns by setting up annotation configs in the project settings, but arbitrary custom fields beyond these are not currently supported for display as columns. For more advanced needs, exporting data and visualizing it externally is recommended. Would you like more detail on configuring annotation columns or exporting annotation data?Sources: - GitHub Issue: custom attributes on spans - Annotating in the UI
💡 Hint: Mention RunLLM in the thread for followups.
Hi Xander S., I’d just like to have the option to view more detailed information directly in the annotations. For example, I’m using an LLM as a judge to rate outputs on a scale from 1 to 5. Sometimes the judge agrees with the initial score given by the first agent, and sometimes it doesn’t, then its providing his rating. So ideally, I’d like to have two custom columns: one for the initial score and one for the final score — to make it easier to compare and analyze the results.
This strikes me as metadata. Have you tried adding as metadata to the annotation?
