I have a set of Ground truth Dataset that i am trying to use in Benchmarking the efficacy of my Rag system which works with a MCP server and a Agentic system with Subagents using the MCP for Querying and retreiving sources.
Which platform would support it ?
Hi chezky K. From my understanding, seems like you have a ground-truth dataset and you want to use it to benchmark how well your RAG system performs.
You can use either Phoenix or AX for this. The workflow would involve uploading that dataset to the platform and setting up an experiment that includes an eval to see how output from your system matches the expected output (from the ground truth dataset).
This Phoenux cookbook doesn't match your exact use case BUT it does address using an eval to see how an output matches your ground truth: https://arize.com/docs/phoenix/cookbook/ai-engineering-workflows/creating-a-custom-llm-evaluator-with-a-benchmark-dataset
