lauching a script using run_experiment can't stop with ctrl-c, what's the recommended way to stop an experiment after it gets started?
馃挕聽Hint: Mention RunLLM in the thread for followups.
I'm using arize-phoenix 8.32.0
it just doesn't respond to ctrl-c and keeps running
it seems spawning many processes under the hood when checking with ps ax
it's not stuck. I just realize some error in my task, so would like to stop the expeirment, fix the bug, and rerun.
I mostly ask because run_experiment should not be spawning processes unless your task is doing so
are you running run_experiment in sync or async mode?
(if you are using nest_asyncio then it should be running in async mode by default)
nope. my script is very simple, basically just
experiment = run_experiment(
dataset,
my_task,
evaluators=[eval_1, eval_2],
experiment_metadata={"model": f"{_SELECT_MODEL}"},
# dry_run=1,
)with my_task being just a simple llm call and a few custom evaluators
run_experiment should not be spawning processes unless your task is doing so
doesn't run_experiment process all the rows in parallel in some fashion?
or it's just processing every row in dataset one by one?
it processes them in parallel if you're using nest_asyncio in a notebook or separately in a script
