Setting Up Eval Tracking in Langchain's Docker Container

·Jun 03, 2024 07:47 AM

Hiiii How can i make an eval and return it whenever the trace is done? I am using langchain langgraph and i wanted to know how can i setup the code to be used in a docker container of phoenix and track evals of each trace

2 comments

· Sorted by Oldest

Xander S.
·
Hey Rayen N., Phoenix does not currently support online evals. We suggest setting up a cron job as described here. Hope this helps!
Jason
·
Rayen N. Included is an early example here with Span level evals run inline with the tracing: https://colab.research.google.com/drive/1zBhAPUW5s-oFZFnYVYFjeWqKceFgC8wm?usp=sharing

Xander S.
·
Hey Rayen N., Phoenix does not currently support online evals. We suggest setting up a cron job as described here. Hope this helps!
Jason
·
Rayen N. Included is an early example here with Span level evals run inline with the tracing: https://colab.research.google.com/drive/1zBhAPUW5s-oFZFnYVYFjeWqKceFgC8wm?usp=sharing