Understanding Token Counts for AI Developers: A Tutorial

My second video for AI developers is about token counts. Yes, really. The number of tokens used by your LLM application can be really useful in uncovering patterns and issues. With token counting, you can answer questions like: are there too many tokens in my context window? Which spans are using up the most tokens in the LLM chain? Are there problematic sessions or traces that are too long or short? Which parts of an LLM application are costing the most? This tutorial dives into how Arize calculates token count and useful ways to analyze token counts with the Arize platform. Watch: https://www.youtube.com/watch?v=mpifjVPXPdE