Debugging KeyError in DataFrame: Missing Index Columns

hi team, any ide from this error? KeyError: "['attributes.input.value', 'attributes.retrieval.documents'] not in index" from my code

spans_df = px.Client().get_spans_dataframe()
spans_df[["name", "span_kind", "attributes.input.value", "attributes.retrieval.documents"]].head()

· Sorted by Oldest

RunLLM
APP
·
The error KeyError: "['attributes.input.value', 'attributes.retrieval.documents'] not in index" indicates that the columns attributes.input.value and attributes.retrieval.documents are not present in the DataFrame returned by get_spans_dataframe().According to the Phoenix documentation, the get_spans_dataframe() method should return a DataFrame with these columns if the spans contain the relevant attributes. If these columns are missing, it could be due to the spans not having these attributes or an issue with the data retrieval.Would you like more detail on how to troubleshoot this issue?Sources: - Phoenix documentation
💡 Hint: Mention RunLLM in the thread for followups.
Anastasia B.
·
this happen after i clear data in the UI, and run the evaluation again
Roger Y.
·
is spans_df empty since no spans are left?

yes, when i print resulting:

Empty DataFrame
Columns: [name, span_kind, parent_id, start_time, end_time, status_code, status_message, events, context.span_id, context.trace_id]

Roger Y.
·
yea, those attributes. columns are derived from spans. without any spans to look at, it doesn’t know what columns to return
Anastasia B.
·
any solutions to fix this? i already deploy the UI in separate code, and want to evaluate the RAG in another code
Roger Y.
·
are you able to send more spans?
Roger Y.
·
the deleted ones can’t be recovered
Anastasia B.
·
already do this for 15 query response = query_engine.query(query) and after that i run code for spans df, and resulting error like above
Roger Y.
·
are you seeing any spans in the UI?
Roger Y.
·
this happen after i clear data in the UI
were those the data from the query engine?
Anastasia B.
·
no, just like this
Roger Y.
·
if you click projects on the left hand side, how many projects show up?
Roger Y.
·
and you had spans at some point, right? did those come from the query_engine?
Anastasia B.
·
just 1