Truong H.

Commented on Converting PromptVersion to Templating Template: B...·Posted inPhoenix Support

Truong H.

thanks, I was going to create an issue on github but saw that you guys already did that!

Commented on Converting PromptVersion to Templating Template: B...·Posted inPhoenix Support

Truong H.

Hi Xander S., that's exactly it!! my usecase is basically:

fetch a saved prompt in phoenix server
then:

either setup an experiment and pass several LLMEvaluators (such as ClassificationEvaluator) to the experiment
or use evaluate_dataframe for local experimentation

Hope that makes sense! Also I'm on arize-phoenix-evals==2.6.0 and arize-phoenix-client==1.24.0

Posted in Discussions·

Truong H.

Cross-Posting for Increased Visibility in Slack Channel

Hi, cross-posting here for more visiblity: https://arize-ai.slack.com/archives/C04R3GXC8HK/p1766461405752589

0Comments

Posted in Phoenix Support·

Truong H.

Converting PromptVersion to Templating Template: Best Practices

Hi all, is there an official, graceful way to convert between phoenix.client.types.PromptVersion and phoenix.evals.templating.Template?

phoenix.client.types.PromptVersion has a _dumps which allows me to get the raw template, but it's an internal method. Otherwise format only produce the final prompt with all variables provided. I can probably do something like this: prompt.format(variables={"text": "{text}"}) but that seems a bit hacky.
LLMEvaluator class receives a prompt_template parameter, so I need to have the raw prompt available.

Any help is greatly appreciated. Thank you!

4Comments

Commented on Need Help Finding API Key for Arize Phoenix 11.8 P...·Posted inPhoenix Support

Truong H.

I'm checking out the linked docs, look very promising, I'm testing it out now. Thank you!

Posted in Phoenix Support·

Truong H.

Need Help Finding API Key for Arize Phoenix 11.8 Python SDK

Hi all, not sure if this is a stupid question but I'm using arize phoenix 11.8, currently deployed locally for testing, and I need to get an API key to authenticate the python SDK client. However I cannot find any option to export the API key here. Would be great if anyone can help enlighten me... Google searching has not returned anything so far. Thanks!

1 attachment

3Comments