Hi Team, while running experiments on dataset, I want to structure the output in such a way that results and other metadata received from the streaming responses are stored in separate columns, rather than them being intertwined together. Ideally, I want a clear distinction between the result data and any other metadata or supplementary information, possibly in a tabular format. i want a new column in results (referring to image), is that possible ?
To structure the output of your experiments with separate columns for results and metadata, you can utilize the phoenix.Schema to define your dataset schema, specifying distinct columns for each type of data. According to the Phoenix documentation, you can define a schema with specific column names for predictions, actuals, features, and tags. This allows you to organize your data in a tabular format with clear distinctions between different types of information.If you want to add a new column to store additional metadata, you can modify your dataframe before uploading it to Phoenix. For example, you can add a new column to your pandas dataframe and then define it in your schema as a feature or tag column. This approach ensures that your results and metadata are stored separately and can be easily accessed and analyzed.Would you like more detail on how to implement this in your code?Sources:
- Phoenix documentation
馃挕聽Hint: Mention RunLLM in the thread for followups.
This is for uploading dataset, not for running experiments and storing the results in different columns, if anyone knows please help here
Mikyo correct me if I'm wrong but I'm not aware of a column customization feature yet. If not we can gladly file an enhancement request
Hey shreeranga k. I might not quite follow what you mean by separate columns but if you return a JSON serializable object from your task that object will be stored. The keys ostensibly are columns (e.g. output.text, output.metadata, output.id etc.). You can check out the concepts section here. https://docs.arize.com/phoenix/datasets-and-experiments/concepts-datasets#creating-datasets
If you are talking about the UI, Tony is correct, there's no way to expand the table right now. Definitely let us know if that's what you are looking for!
yes i need separate columns to store output and other metadata in UI.
