Hey team, do we have some quickstart guides/notebooks/scripts to get started with ArizeAI for LLM applications?
My team is exploring some options for observability and monitoring, and Arize is one of the candidate.
I will describe my use-case pretty quickly and if you think Arize is not suited for that, please lmk:
Currently we use OpenAI for LLM based applications backed behind langchain. One of the key application is a chatbot which answers questions of our customers' customers, and is powerd via llms + some traditional ml algos (sentiment eval, etc)
What we want is to be able to track requests end-to-end, allow users to give feedback against some predictions we made, curate dataset, do evaluation (fine-tuning/training), do A/B testing for prompts, etc.
Let me know if this sounds like something Arize can help us with?
