Inquiry on Groq Model Support in Evaluation with Llama Workaround

ram l. · 2025-01-16T14:41:14.049Z

Hi, Regarding eval, I see the following supported models https://docs.arize.com/phoenix/api/evaluation-models. I dont see Groq Model support (it is supported in trace). Any work around for groq using llama ?

It seems likely that Groq models are not directly supported for evaluation in Phoenix, as they are primarily mentioned in the context of tracing. However, you might consider using a workaround by implementing a custom model class similar to how other custom models are integrated. For instance, you could create a custom class that interfaces with Groq models using a similar approach to the CustomModel example provided for other LLMs.Would you like more detail on how to implement such a custom model class? Sources: - https://github.com/Arize-ai/phoenix/issues/2117

💡 Hint: Mention RunLLM in the thread for followups.

4 comments