Introducing Labeling Queues for Scalable Dataset Annotation

🗒️ Labeling Queues Are Here! We just shipped Labeling Queues in Arize AX, making dataset annotation more scalable and efficient—so teams can improve AI app & agent performance faster with high-quality, labeled data. Here’s what’s new: ✨ New Annotator Role – A dedicated RBAC role with focused permissions, ensuring annotators only see assigned records while keeping other data secure. 📌 Seamless Queue Creation – Create Labeling Queues directly from dataset records, with annotations automatically written back for easy tracking. 🔄 Annotation Resets – AI Engineers can reset annotations, allowing re-labeling when needed. 🎯 Flexible Assignment Methods – Choose between Random or All assignments for annotators in a queue. ⚡ Fast & Streamlined UI – Optimized for quick labeling workflows with: Hotkey support, background data fetching & pagination, and background submissions. Check out the full details in our docs: https://docs.arize.com/arize/llm-evaluation-and-annotations/how-to-labeling-queues