Troubleshooting LLM Function Call Issues in Phoenix Playground

·Apr 07, 2025 05:59 PM

Hello, I'm encountering an issue with the Playground while using Phoenix to log traces of an OpenAI agent. When I select a specific LLM call from the trace and open it in the Playground, it loads, but the tools aren't available. As a result, when I rerun a function-calling step—even without making any changes—the LLM returns a regular text response instead of responding with a function call. It seems like the Playground isn't properly loading the tools context for those steps. Could you help me resolve this?

5 comments

· Sorted by Oldest

RunLLM
APP
·
The issue you're experiencing with the Playground not loading tools context properly might be related to how the tools are being defined and loaded in the Playground. According to the <https://docs.arize.com/phoenix/tracing/integrations-tracing/openai|Phoenix documentation>, Phoenix supports tracing and replaying LLM spans, including function calls, in the Playground. However, if the tools are not correctly defined or if there's a mismatch in the tool schema, it could lead to the behavior you're observing. To resolve this, ensure that the tools are correctly defined and that the Playground is set up to recognize them. You might need to check the tool definitions and ensure they are compatible with the Playground's expected format. Additionally, verify that the Playground is correctly configured to load the tool context by checking the tool schema and ensuring it matches the expected format for the LLM you're using. Would you like more detailed guidance on how to check and configure the tool definitions? Sources: - <https://docs.arize.com/phoenix/tracing/integrations-tracing/openai|Phoenix documentation>
💡 Hint: Mention RunLLM in the thread for followups.
Mohammed E.
·
Hello John G. Here are the answers to your questions:
No errors seen in the playground.
I am using LlamaIndexInstrumentor
The used versions are:
arize-phoenix = "8.14.1"
arize-phoenix-otel = "0.8.0"
Mohammed E.
·
John G. No, there's no tools tab in the trace.
Mohammed E.
·
Roger Y.
·
We released a fix in openinference-instrumentation-llama-index: v4.2.1. Please give it a try when you have chance. Thanks again for raising this issue.