Arize AI Community Icon

Home
Events

Arize AX Releases
Arize AX Support
Arize News
Arize Observe
Discussions
Introductions
Phoenix Support

Powered by Tightknit

Phoenix Support

Phoenix Support

Help Needed: Ragas Retrieval Evals Tutorial Colab Notebook Error

·May 17, 2024 07:54 AM

Hi there, I was trying ragas retrieval evals tutorial colab notebook, came to find this which is throwing the error: Can anyone tell what is the right line of code to write there?

4 comments

· Sorted by Oldest

Soubhik M.
·
Line 5 throws an error for me
Dustin N.
·
can you check what the relative order the spans are in when compared to the eval_df? Line 5 is only a check to make sure all your questions line up when constructing the eval dataframe
Soubhik M.
·
Dustin N. My problem was the thing written in line 7, in the end, because of which the code block is not running. I tried removing it and running the code again but it failed, hence asking for correct code.
Dustin N.
·
hi soubhik, yeah, like 5-7 are just checking to make sure your data is in the right format, I'm just wondering if you've checked if the lists both contain the same elements but but might be reordered. One way to do this is to check a counter of each list
from collections import Counter Counter(eval_data_df.question.to_list()) == Counter(spans_dataframe.input.to_list())
if this is True, try removing reversed, if the difference is more complex than that, please try and let us know how the datasets differ and I can investigate