Hi, Not sure if this is the right place but I'm having real trouble pulling back traces from the server for post analysis. I'd like to get a tranch of say the last 5 days. But it results in errors, best I can do is do it daily then I get something. However, the service seems to break for the 28th Feb -> 1st March. It also breaks when I request data for this Monday 3rd March to 4th March, but I know something is there. Also a lot of 503 errors service not available. Any help would be much appreciated.
It seems likely that you are encountering issues with retrieving traces from the Phoenix server due to potential server-side limitations or configuration issues. According to the Phoenix documentation, you can specify a time range when querying spans, but if the server is returning 503 errors, it might be due to server capacity or configuration issues. You might want to check the server logs for any errors or warnings that could indicate why the service is unavailable during those specific time frames. Additionally, ensure that your server is not hitting any resource constraints, as mentioned in a GitHub issue where similar problems were discussed. Would you like more detail on how to troubleshoot or configure your server to handle these requests better?Sources: - Phoenix Documentation on Exporting Data - GitHub Issue on Phoenix Crashing
馃挕聽Hint: Mention RunLLM in the thread for followups.
I'm using (1) and
import phoenix as px
start = datetime.strptime('2025-02-14','%Y-%m-%d')
end = datetime.strptime('2025-02-15','%Y-%m-%d')
tdf = px.Client().query_spans(query,start_time=start, end_time=end,project_name='xxxxx',timeout=None,limit=-1)I've xx'd out our app name in the real case it contains our app
arize.phoenix lib is latest from pip as of Monday
Ok