Everything you wanted to know about LLM Evals, Part 1 of 3.
Evals are fundamental to building great LLM applications. Even if you鈥檙e an experienced AI engineer or just getting started, getting the foundations right and understanding this concept deeply, is a great way to have a good sense of where to iterate and improve as you build and develop in the space.
If you need a good LLM as a Judge framework take a look at Arize AI Phoenix or even ragas. There鈥檚 no one size fit鈥檚 all, and exploration is a good place to start!
Stay tuned for parts 2 and 3 with Eric Xiao!
https://www.youtube.com/watch?v=9Ay0WcjrdGE