Brandon

Commented on Clarification on Dataset Reference Field in CSV Fi...·Posted inArize AX Support

Brandon

Thanks for confirming Aparna, the Agent was helpful.

Posted in Arize AX Support·

Brandon

Clarification on Dataset Reference Field in CSV Files

Hello! I'm trying to make sense of the dataset "reference" field. I'm a little confused as to how I should leverage it.

1.
Should this be an empty column in my csv to place experiment output?
2.
What does the example in the help text actually mean? I don't understand why dataset.reference maps to dataset.attributes.output.values

This is a mapping, typically used to represent the output column. It can be used as a shortcut when writing eval templates to compare against experiment outputs. For example {dataset.reference} maps to {dataset.attributes.output.value}

Thanks

2Comments

Commented on Reducing Latency in LLM Calls and Project UI Trace...·Posted inArize AX Support

Brandon

Hello! I wanted to check back in on the expected behavior here. 🔒[private user]

Commented on Streamline Your Prompt Engineering with Arize's Pr...·Posted inArize AX Releases

Brandon

Custom Code Evals for all Business tier would be great!

Commented on Introducing Cost Tracking for LLMs: Simplify Your...·Posted inArize AX Releases

Brandon

Sanjana Y. Not that immediately comes to mind other than reflecting the model pricing in our own databases as well. I'm finding it difficult to extract information such as annotation results, experiment results, and trace data out of Arize. Really easy to put info in Arize, kinda tricky to get it out seemingly.

Commented on Reducing Latency in LLM Calls and Project UI Trace...·Posted inArize AX Support

Brandon

No, I'm using the Arize Cloud Platform. Do y'all refer to that as Phoenix Cloud?

Commented on Streamline Your Prompt Engineering with Arize's Pr...·Posted inArize AX Releases

Brandon

Is this feature only available to Enterprise customers?

Commented on Introducing Cost Tracking for LLMs: Simplify Your...·Posted inArize AX Releases

Brandon

Sanjana Y. Is there an API to access this data table?

Commented on Reducing Latency in LLM Calls and Project UI Trace...·Posted inArize AX Support

Brandon

Maybe I'm abusing the feature?

Commented on Reducing Latency in LLM Calls and Project UI Trace...·Posted inArize AX Support

Brandon

At least 3mins