Distinction Between Phoenix Evals SDK and Platform Tasks

·Mar 28, 2025 03:07 PM

Is there a distinction between the outputs of pheonix.evals (SDK) and tasks (platform), if not it would be pretty useful to be able to upload or download evals from the SDK, like huggingface_hub

4 comments

· Sorted by Oldest

Xander S.
·
I'm not super familiar with tasks in the Arize AX platform, but they do use phoenix.evals under the hood. Julia G. Any differences to be aware of here?
Xander S.
·
Sebastian S. It sounds like you are looking for the ability to download your data with evals. This is possible in Phoenix. We have a REST API coming soon for Arize AI!
Julia G.
·
Yeah that's correct, we are just calling llm_classify in Arize online evals. There are not any differences--the only other component is how we load in and pre-process the data before calling llm_classify, which is visible from the Test in Code button
🙌1
Julia G.
·
it would be pretty useful to be able to upload or download evals from the SDK, like huggingface_hub
Great idea, we are actually looking into an evaluator hub! I'll check out the Huggingface Hub and will circle back once we have a more detailed roadmap to get your thoughts
🔥1

Xander S.
·
I'm not super familiar with tasks in the Arize AX platform, but they do use phoenix.evals under the hood. Julia G. Any differences to be aware of here?
Xander S.
·
Sebastian S. It sounds like you are looking for the ability to download your data with evals. This is possible in Phoenix. We have a REST API coming soon for Arize AI!
Julia G.
·
Yeah that's correct, we are just calling llm_classify in Arize online evals. There are not any differences--the only other component is how we load in and pre-process the data before calling llm_classify, which is visible from the Test in Code button
🙌1
Julia G.
·
it would be pretty useful to be able to upload or download evals from the SDK, like huggingface_hub
Great idea, we are actually looking into an evaluator hub! I'll check out the Huggingface Hub and will circle back once we have a more detailed roadmap to get your thoughts
🔥1