Hey, do you plan to support message content as list in request payloads? This is part of the standard Open AI format when using VLMs and i.e. Smolagents defaults to it. As of now the Arize UI just shows empty blocks for system/user prompt
Phoenix does support message content as a list in request payloads. According to the OpenAI instrumentation, the system can handle message content that includes lists, such as text and image URLs. This is consistent with the OpenAI format for handling various content types in messages.If the Arize UI is showing empty blocks for system/user prompts, it might be due to a configuration or integration issue. Ensure that the message content is correctly formatted and that the UI is updated to handle these message types. Would you like more detail on how to configure this or troubleshoot the issue?Sources: - OpenAI Instrumentation
馃挕聽Hint: Mention RunLLM in the thread for followups.
Yea, we can support it. Can you let us know which instrumentor you鈥檙e currently using? I can look into it
Thanks! I鈥檓 using:
from phoenix.otel import register
from openinference.instrumentation.smolagents import SmolagentsInstrumentor
tracer_provider = register(
project_name="default"
)
SmolagentsInstrumentor().instrument(tracer_provider=tracer_provider)And in smolagents I鈥檓 using their standard OpenAIServerModel
I think there's an active fix out to account for the changes in smolagents! https://github.com/Arize-ai/openinference/pull/1238
