Mateusz K.

Commented on Question About Using Google Models in LLM Class on...·Posted inPhoenix Support

Mateusz K.

AttributeError

'GoogleGenAIModel' object has no attribute 'generate_classification'

Posted in Phoenix Support·

Mateusz K.

Question About Using Google Models in LLM Class on Vertex AI

Hey everyone! It's me again, but this time I wanted to ask about evals. Do I need to connect to Vertex AI, to use Google models in LLM class? I tried the following and I get the error of unrecognized provider:

llm = LLM(model="gemini-2.5-flash", provider="google")

5Comments

Commented on Connecting Python to Arize Phoenix Container for M...·Posted inPhoenix Support

Mateusz K.

Thanks! It worked!!

Commented on Connecting Python to Arize Phoenix Container for M...·Posted inPhoenix Support

Mateusz K.

How do I send a trace? As fas as I understand, I should just make a call to the LLM or am I wrong? I call this function:

from google import genai

def classify_tender(prompt: str, api_key: str) -> dict:
    client = genai.Client(api_key=api_key)

    response = client.models.generate_content(
        model="gemini-2.5-flash",
        config=genai.types.GenerateContentConfig(
            system_instruction="You classify reviews according to company profile.",
        ),
        contents=prompt
    )
    return response

Posted in Phoenix Support·

Mateusz K.

Connecting Python to Arize Phoenix Container for Model Inspection

Hey everyone! I am running an arize-phoenix container on my laptop:

docker run -p 6006:6006 -p 4317:4317 -i -t arizephoenix/phoenix:latest

I want to connect to it with Python:

from phoenix.otel import register

project_name = "phoenix-arize-demo"
tracer_provider = register(
  project_name=project_name,
  endpoint="http://localhost:6006/v1/traces",
)

However, I don't see a project called "phoenix-arize-demo" when i go to localhost:6006. I tried also

import os
os.environ["PHOENIX_COLLECTOR_ENDPOINT"] = "http://localhost:6006

Doesn't help. I have a small dataset from which LLM is supposed to classify pieces of text into three categories and I wanted to use phoenix arize to inspect model outputs.

8Comments