Best Practices for Annotating Agentic Traces and Long Responses

·Dec 20, 2024 06:59 AM

curious if there are best practices for annotating or tagging agentic traces -- or long context responses; most examples are super short chat input/output examples

6 comments

· Sorted by Oldest

Jessica H.
·
ya, this is helpful -- I guess I probably need an overview - we just got our traces moving in arize - and when looking at any of the samples for annotations or taggin they are so basic that I can't translate them to my real world
Jessica H.
·
Or .. if I did .. I'm looking at a lot of work, which there has to be a programmatic way of doing this
Jessica H.
·
and ya, I've also seen the support chat example, its not at all related and hard to map what I'm doing to it -- essentially in one example (and in most examples) I'll have a supervisor agent and a gang of agents executing, supervisor agent is the decision maker tho
Jessica H.
·
and its cyclical or can be.. not linear.. so there are potential loops between agents within the infrastructure
Jessica H.
·
not a single supervisor router decision then onward.. many supervisor decisions
Jessica H.
·
thanks Dat!
:np:1

Jessica H.
·
ya, this is helpful -- I guess I probably need an overview - we just got our traces moving in arize - and when looking at any of the samples for annotations or taggin they are so basic that I can't translate them to my real world
Jessica H.
·
Or .. if I did .. I'm looking at a lot of work, which there has to be a programmatic way of doing this
Jessica H.
·
and ya, I've also seen the support chat example, its not at all related and hard to map what I'm doing to it -- essentially in one example (and in most examples) I'll have a supervisor agent and a gang of agents executing, supervisor agent is the decision maker tho
Jessica H.
·
and its cyclical or can be.. not linear.. so there are potential loops between agents within the infrastructure
Jessica H.
·
not a single supervisor router decision then onward.. many supervisor decisions
Jessica H.
·
thanks Dat!
:np:1