Issue with Incomplete User Messages in Phoenix Dataset Download

ROHAN B. · 2024-11-20T13:01:59.122Z

I've added spans to a dataset and then downloaded it. I can not see user messages in the dataset, although they are clearly present in the spans when I view them in projects. when downloaded, all I get is: {"role": "user"}, and no "content"for role user How can I download the complete list of messages from phoenix?

Issue with Incomplete User Messages in Phoenix Dataset Download | Arize AI Community

13 comments

· Sorted by Oldest

RunLLM
APP
·
It seems likely that you can download spans, including user messages, using the get_spans_dataframe method from your Phoenix session object. This method allows you to pull a DataFrame of the traces and optionally filter them. If user messages are part of the span attributes, ensure that you are selecting the correct attributes when querying the spans.Here's a basic example of how you might retrieve spans: LBKSimport phoenix as pxLBKS# Initialize client client = px.Client()LBKS# Retrieve spans DataFrame spans_df = client.get_spans_dataframe()LBKS# Check if user messages are included in the DataFrame print(spans_df.head())LBKSIf user messages are not appearing, verify that they are included in the span attributes and that you are querying the correct project or time range. Would you like more detail on any specific part?Sources: - https://docs.arize.com/phoenix/tracing/how-to-tracing/extract-data-from-spans#bOaHNYT91AAE
💡 Hint: Mention RunLLM in the thread for followups.
Dustin N.
·
hey ROHAN B. thanks for using Phoenix! This is a great question and seems like a bug to me. I'll investigate!
Dustin N.
·
may I ask what method you're using to download your dataset?
ROHAN B.
·
I tried all three of these from the datasets UI, none showed content from the role user I also tried another method get_spans_dataframe mentioned by the bot, it gave me connectError, maybe I missed something here
ROHAN B.
·
Hi Dustin N.! Any update on this? the issue still persists for me. I would appreciate your help
Dustin N.
·
ROHAN B. what did you use to generate the datasets? What are the inputs? Depending on how you structured your inputs and tasks, the full list of messages might not appear in your datasets themselves, but rather the traces of the tasks that you use to run them
ROHAN B.
·
Dustin N. I used phoenix itself to generate the dataset from the spans of a phoenix project. I need to export the spans, so I added the spans to a dataset and downloaded the csv and jsonl, but in both cases, I find the content for the role user missing :(
Hakan T.
·
Hey Rohan, when you use the get_spans_dataframe, what kind of error do you get?
Dustin N.
·
also, it looks like your connection error might be because you haven't set the endpoint on your client to point to hosted phoenix?
Roger Y.
·
is this using the latest version of Phoenix?
Roger Y.
·
which instrumentor was used to generate the spans?
Roger Y.
·
i am not able to reproduce this issue
Roger Y.
·
what if you try to add the span to a new dataset?

RunLLM
APP
·
It seems likely that you can download spans, including user messages, using the get_spans_dataframe method from your Phoenix session object. This method allows you to pull a DataFrame of the traces and optionally filter them. If user messages are part of the span attributes, ensure that you are selecting the correct attributes when querying the spans.Here's a basic example of how you might retrieve spans: LBKSimport phoenix as pxLBKS# Initialize client client = px.Client()LBKS# Retrieve spans DataFrame spans_df = client.get_spans_dataframe()LBKS# Check if user messages are included in the DataFrame print(spans_df.head())LBKSIf user messages are not appearing, verify that they are included in the span attributes and that you are querying the correct project or time range. Would you like more detail on any specific part?Sources: - https://docs.arize.com/phoenix/tracing/how-to-tracing/extract-data-from-spans#bOaHNYT91AAE
💡 Hint: Mention RunLLM in the thread for followups.
Dustin N.
·
hey ROHAN B. thanks for using Phoenix! This is a great question and seems like a bug to me. I'll investigate!
Dustin N.
·
may I ask what method you're using to download your dataset?
ROHAN B.
·
I tried all three of these from the datasets UI, none showed content from the role user I also tried another method get_spans_dataframe mentioned by the bot, it gave me connectError, maybe I missed something here
ROHAN B.
·
Hi Dustin N.! Any update on this? the issue still persists for me. I would appreciate your help
Dustin N.
·
ROHAN B. what did you use to generate the datasets? What are the inputs? Depending on how you structured your inputs and tasks, the full list of messages might not appear in your datasets themselves, but rather the traces of the tasks that you use to run them
ROHAN B.
·
Dustin N. I used phoenix itself to generate the dataset from the spans of a phoenix project. I need to export the spans, so I added the spans to a dataset and downloaded the csv and jsonl, but in both cases, I find the content for the role user missing :(
Hakan T.
·
Hey Rohan, when you use the get_spans_dataframe, what kind of error do you get?
Dustin N.
·
also, it looks like your connection error might be because you haven't set the endpoint on your client to point to hosted phoenix?
Roger Y.
·
is this using the latest version of Phoenix?
Roger Y.
·
which instrumentor was used to generate the spans?
Roger Y.
·
i am not able to reproduce this issue
Roger Y.
·
what if you try to add the span to a new dataset?