Add Env Variables for Azure OpenAI in Docker Run Command

Swaraj R. · 2024-12-23T18:54:31.141Z

@RunLLM what are the env variables i should add to my docker run command so I can enable default azure open ai endpoint and keys for playground runs i current am doing only this docker run -d -e PHOENIX_SQL_DATABASE_URL=" " -p 6006:6006 -p 4317:4317 -i -t arizephoenix/phoenix:version-7.3.0

Add Env Variables for Azure OpenAI in Docker Run Command | Arize AI Community

RunLLM
APP
·
To enable the default Azure OpenAI endpoint and keys for Phoenix Playground runs, you need to set the AZURE_OPENAI_API_KEY and AZURE_OPENAI_ENDPOINT environment variables in your Docker run command. According to Phoenix documentation, these variables are necessary for using Azure OpenAI API with Phoenix.Would you like more detail on how to configure these environment variables in your Docker command? Sources: - Phoenix documentation
💡 Hint: Mention RunLLM in the thread for followups.
Swaraj R.
·
RunLLM yeah gimme a tempalte docker command that i'll fill in
RunLLM
APP
·
Certainly! Here's a template for your Docker run command with placeholders for the Azure OpenAI endpoint and API key: LBKSdocker run -d \ -e PHOENIX_SQL_DATABASE_URL="<pg-connection-string> " \ -e AZURE_OPENAI_API_KEY="<your-azure-openai-api-key> " \ -e AZURE_OPENAI_ENDPOINT="<your-azure-openai-endpoint> " \ -p 6006:6006 \ -p 4317:4317 \ -i -t arizephoenix/phoenix:version-7.3.0LBKSReplace <pg-connection-string> , <your-azure-openai-api-key> , and <your-azure-openai-endpoint> with your actual PostgreSQL connection string, Azure OpenAI API key, and endpoint URL, respectively.Would you like more details on any specific part of this setup?Sources: - https://arize-ai.slack.com/archives/C04R3GXC8HK/p1723828797.781399 - https://docs.arize.com/phoenix/deployment/environments
💡 Hint: Mention RunLLM in the thread for followups.
Swaraj R.
·
hmm this is not working as expected, getting a 401 error from azure when i configure it like this
Mikyo
·
Hey Swaraj R. - sorry for the hallucination by RunLLM. it should be these three https://docs.arize.com/phoenix/prompt-engineering/overview-prompts#option-2-set-environment-variables-on-server-side
AZURE_OPENAI_API_KEY
AZURE_OPENAI_ENDPOINT
OPENAI_API_VERSION
Let us know if that works?
Swaraj R.
·
yeah I added these actually
AZURE_OPENAI_API_KEY
AZURE_OPENAI_ENDPOINT
OPENAI_API_VERSION
but still seeing a 401 issue 🤔 Do the logs show the API call to azure open ai?
Mikyo
·
Huh, maybe Dustin N. - can take a look? Just confirming it does work if you fill it out in the UI?
Swaraj R.
·
actually now i can't get to this view on the UI only show these two views if i go to playground directly vs from a trace
Swaraj R.
·
not sure how to re-configure keys/provider from scratch
Dustin N.
·
Yeah I can take a look Ill be back from lunch in like 30
Swaraj R.
·
i can try remove the keys from docker, i guess that'll trigger the view
Swaraj R.
·
yeah no rush at all
Swaraj R.
·
take your time
Mikyo
·
hey Swaraj, we actually treat Azure as a different provider. You can switch the model here.
Mikyo
·
It's a good note though - I'll file a ticket to make finding all your credentials easier

36 comments