Another thing I’d like to ask: does this project ever plan on supporting running datasets as payloads to arbitrary APIs in the future? My LLM agents do complex things and I’d love to let my business analysts create data sets in Phoenix and click a “test run” type of button on all of them on a live API. I know I could set this up myself using the Python API - but would love to do it natively. I’d also be very interested in contributing a pull request to help develop this feature.
💡 Hint: Mention RunLLM in the thread for followups.
Hey Graham R., we do support an experiments API that allows you run arbitrary code (including invoking an agent). Not sure if that is what you have in mind. https://arize.com/docs/phoenix/datasets-and-experiments/overview-datasets
