Evaluating Test Cases in Arize Phoenix: A Quick Guide

Hi I attended a talk on arize phoenix yesterday which looked very promising. I had a question on the testcases that I can evaluate with phoenix. Do I have to create the test cases myself or are they dynamically generated with LLM using Phoenix?