Ron C.

i.e take the average

So I am able to add the annotations to individual experiment example traces, but no way of aggregating across the entire experiment

so I want to keep track of if I am improving based on human feedback with subsequent experiments

yes, but that is a regular eval that i loaded in with LLM as a judge (clearly the rules aren't very accurate 😅) But I want to go in and add my own eval of how accurate the rule is based on my human opinion, because the LLM as a judge isn't so good

Because we can add the labels, but I can't see the aggregated results for that experiment.

Ahh, this is for spans and traces, I am more interested in specific experiment runs

Yep, that makes sense, thanks sanjana

or maybe that is just because I did this 2 weeks later

What's weird is when you sign up with google you get legacy token that works with the headers (simple token) but when you create account with email and password it takes you to the new portal with new key structure