Join Our AMA on Agent Evaluation with Experts on March 18!
👋 Heads up: If you've taken our DeepLearning course (or if you haven't but you're interested in agent evaluation), John G. and Aman K. will be doing an 🔒[private feed] on March 18 at 3pm PST. Great opportunity to get questions answered that you had while working through the course, or about evaluating agents in general. Head on over to this channel 👉 🔒[private feed]! Here's what's covered in the course:
How to add observability to your agent to gain insights into its steps and know how to debug it.
How to set up evaluations for the agent components by preparing testing examples, choosing the appropriate evaluator (code-based or LLM-as-a-Judge), and identifying the right metrics.
How to structure your evaluation into experiments to iterate on and improve the output quality and the path taken by your agent.