Arize AI Community Icon

Home
Events

Arize AX Releases
Arize AX Support
Arize News
Arize Observe
Discussions
Introductions
Phoenix Support

Powered by Tightknit

Phoenix Support

Phoenix Support

Filtering for Lowest Performing Queries in the UI

·Jul 31, 2024 02:42 PM

How to filter on lowest performing queries? I want to filter by worst performing evaluating queries (worst relevance, hallucination and qa correctness), what's the syntax to do that in the UI?

15 comments

· Sorted by Oldest

Roger Y.
·
can you try the following?
evals['Hallucination_Keyword'] == 'Hallucinated' and evals['QA Correctness_Keyword'] == 'incorrect'
unfortunately relevance at the document level is not filterable right now
Farzad S.
·
this does not work
Roger Y.
·
what’s the issue?
Farzad S.
·
Roger Y.
·
do the conditions work individually?
Roger Y.
·
without the conjunction?
Roger Y.
·
oh, 'Hallucinated' is misspelled. my bad. should be lower case
Farzad S.
·
nope

·

oh my bad, it’s with .label

evals['Hallucination_Keyword'].label == 'hallucinated' and evals['QA Correctness_Keyword'].label == 'incorrect'

Farzad S.
·
That works! Thank you!!!!
Roger Y.
·
np!
Roger Y.
·
btw, if you have score, then it’s .score
Farzad S.
·
One last question, I recall reading somewhere there is a way to tell whether the fault is on the retreiver vs LLM? How do I find that out?
Roger Y.
·
i think you would look at whether the documents retrieved are relevant or not
👍1
Xander S.
·
One last question, I recall reading somewhere there is a way to tell whether the fault is on the retreiver vs LLM? How do I find that out?
Farzad S. Filed an issue for this here.
👍1