Skip to main content

Arize AI Community Icon

Home
Events

Arize AX Releases
Arize AX Support
Arize News
Arize Observe
Discussions
Introductions
Phoenix Support

Powered by Tightknit

Phoenix Support

Phoenix Support

Issue with llm_classify Method and AzureOpenAI Model

·Sep 10, 2024 02:41 PM

Hello, does the llm_classify method work with AzureOpenAI model? I get an atribute error when I run it: 'AzureOpenAI' object has no attribute 'reload_client'

3 comments

· Sorted by Oldest

Issue with llm_classify Method and AzureOpenAI Model | Arize AI Community

RunLLM
APP
·
The llm_classify method does work with the AzureOpenAI model, but there are some known issues and limitations. Specifically, the error you encountered ('AzureOpenAI' object has no attribute 'reload_client') suggests a problem with the Azure OpenAI setup in Phoenix.
According to GitHub Issue #1938, there is a known bug where the _async_client is not set up correctly for Azure OpenAI, leading to subsequent failures. This issue might be related to your error.
Would you like more details on how to potentially resolve this issue or further information on the llm_classify method?
Sources: - GitHub Issue #1938
💡 Hint: Mention RunLLM in the thread for followups.
Dustin N.
·
hi Mahi, llm_classify needs to be passed one of Phoenix's model wrappers. We don't have a wrapper called AzureOpenAI, I imagine you're getting that from an SDK? Support for OpenAI models through Azure are supported in our OpenAIModel :
from phoenix.evals import OpenAIModel
Please read the documentation to see how to set it up with Azure
Mahi
·
Dustin N. alright, thank you.