Tiago F.

so other tool calls or business logic would also run

not at all, if you read the link I sent it’s very different…arize only applies the prompt to the dataset, the feature I mentioned can run the whole trace remotely using the original code

here is an example of what I mean: https://langfuse.com/docs/evaluation/dataset-runs/native-run

I guess not...also the agent graph is ok, but a framework-agnostic "LangGraph Studio" would be much more powerfull.

btw I sent an email to John on sunday and no one picked it up yet

DM me please, thanks

My clients wants to see a demo project. Arize comes with a “arize-demo-generative-llm-tracing” project but lacks examples of Evals, dashboards etc, do you have a more complete demo example? Could you also give me a more detailed demo I can record to prepare, or send me a recording?

I am working with a consulting client and will train them on AI evals and I'm recommending Arize, but I haven't used it myself and need more detailed demo (John gave em a quick demo)