Introducing Annotations in Phoenix for Enhanced Application Tracking
📣 Announcing… Annotations in Phoenix! We’ve long supported adding evaluations to spans in Phoenix, but we’ve found this doesn’t always cover the use cases we see in the community. Maybe you want to mark a particular run of your application to use for few-shot prompting. Or maybe you’re adding in a 👍 👎 user feedback system that you need to track. That’s why we’ve added annotations to the Phoenix platform. Annotations can be logged via UI or API, and allow you to add custom labels to your spans and traces. Use annotations to:
👍 Collect human feedback on your application responses
🏷️ Tag the best (or worst) runs of your application
📊 Build datasets based on annotations to power few-shot prompting or fine-tuning
To see how to set up annotations, check out our latest blog post: https://arize.com/blog/how-to-use-annotations-to-collect-human-feedback-on-your-llm-application/ Or jump straight into the docs: https://docs.arize.com/phoenix/tracing/concepts-tracing/how-to-annotate-traces
