Phoenix Cloud natively supports both OpenRouter and Groq as LLM providers. For OpenRouter, you can use the OpenAI-compatible API by setting your OpenRouter API key and base URL in the playground or as environment variables (OPENAI_API_KEY and base_url). For Groq, it is available as a first-class provider in the playground, and you can select it directly from the provider dropdown鈥攋ust supply your Groq API key when prompted. No custom provider setup is required for either; both are integrated into the Phoenix Cloud UI and prompt playground as selectable options.
For OpenRouter, ensure you use the correct base URL (https://openrouter.ai/api/v1) and your OpenRouter API key. For Groq, select it from the provider list and enter your API key. If you need to set credentials server-side, use the appropriate environment variables as described in the documentation. See <https://arize.com/docs/phoenix/integrations/llm-providers/openrouter/openai-tracing|OpenRouter Tracing> and <https://arize.com/docs/phoenix/integrations/llm-providers/groq/groq-tracing|Groq Tracing> for details.
Would you like more detail or code examples?
Sources:
- <https://arize.com/docs/phoenix/integrations/llm-providers/openrouter/openai-tracing|OpenRouter Tracing>
- <https://arize.com/docs/phoenix/integrations/llm-providers/groq/groq-tracing|Groq Tracing>
- <https://github.com/Arize-ai/phoenix/issues/9901|Phoenix GitHub Issue: Groq as Provider>
