👋 Tomorrow is our last paper read of the year! SallyAnn D. and Nicholas V. will be breaking down a comprehensive survey of research on LLM as a judge.
By “comprehensive,” they’re not kidding-- there are 300+ citations .
There’s also a github repo here that the authors will keep updating, with the goal of providing a one-stop resource for devs + researchers on how to effectively leverage LLM as a judge. This is an amazing resource for anyone who is wanting to keep up with best practices here.
If you’re not already on the list, sign up here: https://arize.com/resource/community-papers-reading/
Newbie: sounds like that's the end for this year. Is there normally a monthly meeting on a video chat? Is there a list of upcoming sessions and the papers to read for them?