No, the current `openinference-instrumentation-litellm` does not log all tools available to the LLM in the trace; it only logs tool calls when they appear in the model's output, not the set of available tools at invocation. This is a known limitation and differs from `openinference-instrumentation-openai`, which does log available tools and enables the "Tools" tab in Phoenix <https://github.com/Arize-ai/openinference/issues/1800|[source]> <https://github.com/Arize-ai/openinference/issues/1750|[source]>.
To display available tools in the Phoenix UI for LiteLLM traces, the instrumentation would need to be extended to log the set of tools provided to the LLM at the start of the call, similar to the OpenAI instrumentation. This is not currently implemented <https://github.com/Arize-ai/openinference/issues/1800|[source]> <https://github.com/Arize-ai/openinference/issues/1751|[source]>.
Would you like more detail on how this could be implemented or tracked?
Sources:
- <https://github.com/Arize-ai/openinference/issues/1800|https://github.com/Arize-ai/openinference/issues/1800>
- <https://github.com/Arize-ai/openinference/issues/1750|https://github.com/Arize-ai/openinference/issues/1750>
- <https://github.com/Arize-ai/openinference/issues/1751|https://github.com/Arize-ai/openinference/issues/1751>
