Inquiry about Instrumentation Package for Google Gemini Integration

·Apr 28, 2025 07:43 AM

RunLLM I see there are are provider integrations to auto instrument openai and anthropic (https://docs.arize.com/phoenix/tracing/integrations-tracing). are there any plans to implement an instrumentation package for google gemini (google-genai)?

9 comments

· Sorted by Oldest

RunLLM
APP
·
It seems likely that there is ongoing work to support Google Gemini instrumentation. According to a <https://github.com/Arize-ai/openinference/issues/1281|GitHub issue>, there is an open feature request for a Gemini auto-instrumentor, indicating that it is not yet supported but is being considered. Additionally, a <https://github.com/Arize-ai/phoenix/pull/2008|pull request> has been merged to add support for Google's Gemini models via the Vertex Python SDK, which suggests progress in this area. Would you like more detail on the current status or potential alternatives for instrumentation? Sources: - <https://github.com/Arize-ai/openinference/issues/1281|GitHub issue> - <https://github.com/Arize-ai/phoenix/pull/2008|pull request>
💡 Hint: Mention RunLLM in the thread for followups.
Anthony P.
·
This is in active development for Python, but I do not have an estimated release date for you. Are you primarily interested in this for Python or JavaScript?
❤️1
Andrew S.
·
python! 🙏
Andrew S.
·
I’m unsure if using vertex ai would meet our needs
Andrew S.
·
tbh, I don’t understand the relationship between the gemini genai package and vertex ai
Anthony P.
·
Google ships a handful of SDKs and hosts a handful of platforms for interacting with LLMs, which can definitely make things a bit confusing 😅 Gemini / google genai tends to be closer to use cases like you would find from the anthropic or openai APIs, while vertex is more enterprise forward and has model management and development tools in addition to API access of LLMs
Andrew S.
·
I’d honestly consider using vertex ai just so I can get tracing with Phoenix haha
Anthony P.
·
We certainly intend to support google genai tracing, no vertex necessary
❤️1
Nicolas D.
·
Looks like a PR was just just merged to support google-genai auto instrumentation! https://github.com/Arize-ai/openinference/pull/1500#event-17526989460 CC: Andrew S.
🔥1
❤️1