hi guys, any way for me to find out how to upload experiment runs to AX ? my plan is to retrieve a dataset from AX, run a task + evals for each example, and run the output + eval results back to AX (like we do with Phoenix). Using typescript, I can see the api ref has docs to create experiments but not write experiment results. Appreciate your help 馃檹
Hi Damith S., thanks for your question! You can upload your experiment runs when you create the experiment, via createExperiment. There isn't necessarily a separate "write experiment results" endpoint; you will include everything in the experimentRuns array when calling that function. a possible workflow you could follow is:
Retrieve your dataset examples using listDatasetExamples
Run your task for each example to get outputs
Run your evaluators to get eval results
Create experiment runs with all the data (outputs + eval results as additional fields)
Call createExperiment with all the experiment runs & you should see it in the UI
Thanks Srilakshmi C.. Where can I find the reference on how to upload the LLM as a judge results into the experiment run? I'm referring to this and it's given info on how to upload the output but not the evaluator results. https://arize.com/docs/api-reference/experiments/create-an-experiment
Yep, I can fix that. Shameless plug: https://youtu.be/0799EL8rdHw?si=lN_FReExjDsTLHXz
