Samantha F.

I should have tried this before haha. But thanks for your input! Appreciate the quick response.

This helped in tackling the error!

yes that's right. I am using GPT 3.5 turbo with Azure OpenAI

OpenAIModel from Phoenix Evals

That would be great! Thanks Xander! 🙂

I'm not sure if Phoenix has this capability currently

Yes that's right

> Also curious, what is your goal for running Phoenix evals in a background thread?

So I have a RAG application and I am tracing it with the help of Phoenix. I want to be able to trace and display the evaluations for each time the RAG application is queried by the end user

If I try to run the evals in a notebook

relevance_evaluator = RelevanceEvaluator(eval_model)

retrieved_documents_relevance_df = run_evals(
    evaluators=[relevance_evaluator],
    dataframe=retrieved_documents_df.head(1),
    provide_explanation=True,
    concurrency=20)

This error pops up:

Yes that's right