Using Open Source Models for Evaluators in Arize

Hello Arize experts, I do not have access to GPT-4 or anything in our network. Can I use an open source model for the evaluators?

· Sorted by Oldest

Mikyo
·
Adam, yes you can - though I think the quality of your evaluations can vary quite a bit. For LLM as a judge GPT models definitely produce the best result. Definitely give a few a try: https://docs.arize.com/phoenix/api/evaluation-models
Adam K.
·
hanks Mikyo

Mikyo
·
Adam, yes you can - though I think the quality of your evaluations can vary quite a bit. For LLM as a judge GPT models definitely produce the best result. Definitely give a few a try: https://docs.arize.com/phoenix/api/evaluation-models
Adam K.
·
hanks Mikyo