Inserting Evaluations Directly into Phoenix DB Without .log_evaluations

Anuraag T. · 2024-07-18T17:29:11.187Z

Hi, is there any way I can insert evaluations into the phoenix's db directly without using .log_evaluations , I'm trying to use the bulk inserter to insert the evals using SpanEvaluation but I suppose it requires some different object like pb.Evaluation is there a way to convert SpanEvaluation object to pb.Evaluation which is used by Bulk Inserter?

Roger Y.
·
right now that’s the only way to insert, and the backend is actually not doing a full-blown bulk insert so converting to pb.Evaluation would give the same outcome for the time being
Anuraag T.
·
but is there a way to convert SpanEvaluation to pb.Evaluation, my approach is not dealing with time, the issue is I can't connect to the client when deployed so I have made some workaround changes to push traces and evaluations directly from phoenix app, if there is a way I can use bulk inserter to insert evaluations using SpanEvaluation object that would be very helpful.
Roger Y.
·
I can’t connect to the client when deployed
can you elaborate on this a bit, i’m not sure if i follow
Roger Y.
·
is there a way to convert SpanEvaluation to pb.Evaluation
the conversion is pretty cumbersome for now and it’s not something we want to expose to users
Anuraag T.
·
the application were dealing with is connecting two differently deployed applications one is flask running openai and other is phoenix server. There are multiple layers inbetween which are restricting the connection between two servers. That's why I'm trying to implement tracing and evaluations with a medium(mongodb). I have implemented tracing with _insert_spans method of Bulk inserter but facing issues while doing the same with evaluations.
Roger Y.
·
I see. So you are inserting directly into the database outside phoenix. How is your _insert_spans implemented? (Either way, pb.Evaluation is not what you want.)
Roger Y.
·
ok, maybe you do want pb.Evaluation
Roger Y.
·
but since it’s an implementation detail, it’s not ideal to depend on it
Anuraag T.
·
I'm just creating a TraceDataset object and using .to_spans method to convert into spans and then push to db using Bulk Inserter's _insert_spans method.
Roger Y.
·
hm
Roger Y.
·
so if i refactor it, it would break for you then?
Anuraag T.
·
is there any workaround if I can't use pb.Evaluations
Roger Y.
·
i am still not clear on how you call that private method in the first place
Anuraag T.
·
Im using old version source code to implement this, a refactor might not break it but moving to new version would.
Anuraag T.
·
Im calling it inside the phoenix app

69 comments