🗒️ Labeling Queues Are Here!
We just shipped Labeling Queues in Arize AX, making dataset annotation more scalable and efficient—so teams can improve AI app & agent performance faster with high-quality, labeled data.
Here’s what’s new:
✨ New Annotator Role – A dedicated RBAC role with focused permissions, ensuring annotators only see assigned records while keeping other data secure.
📌 Seamless Queue Creation – Create Labeling Queues directly from dataset records, with annotations automatically written back for easy tracking.
🔄 Annotation Resets – AI Engineers can reset annotations, allowing re-labeling when needed.
🎯 Flexible Assignment Methods – Choose between Random or All assignments for annotators in a queue.
⚡ Fast & Streamlined UI – Optimized for quick labeling workflows with: Hotkey support, background data fetching & pagination, and background submissions.
Check out the full details in our docs: https://docs.arize.com/arize/llm-evaluation-and-annotations/how-to-labeling-queues
