Final Paper Read of the Year: LLM as a Judge Discussion

👋 Tomorrow is our last paper read of the year! SallyAnn D. and Nicholas V. will be breaking down a comprehensive survey of research on LLM as a judge. By “comprehensive,” they’re not kidding-- there are 300+ citations . There’s also a github repo here that the authors will keep updating, with the goal of providing a one-stop resource for devs + researchers on how to effectively leverage LLM as a judge. This is an amazing resource for anyone who is wanting to keep up with best practices here. If you’re not already on the list, sign up here: https://arize.com/resource/community-papers-reading/