Working on setting up some first experiments, but not going very smooth, must be missing something. Following the tutorials I run into the following issue with the Python client, I was expecting this to work?
"""
pip list | grep arize
arize-phoenix 11.6.2
arize-phoenix-client 1.12.0
arize-phoenix-evals 0.22.0
arize-phoenix-otel 0.12.1
"""
from phoenix.client import Client
from phoenix.experiments import run_experiment
# ⚠️ dataset returned is a client.resources.datasets.Dataset class with examples as a list
dataset = Client().datasets.get_dataset(dataset="MyDataSet")
experiment = run_experiment(
# ⚠️ dataset expected is a phoenix.experiments.types.Dataset class with examples as a Map?
dataset,
MyTask,
evaluators=MyEvaluators
)
# ❌ Breaks with:
# in run_experiment
# for ex, rep in product(dataset.examples.values(), range(1, repetitions + 1))
# AttributeError: 'list' object has no attribute 'values'
