Gordon E.

Commented on Integrating LiteLLM with Llama_index: Seeking MWE...·Posted inPhoenix Support

Thanks! I was able to perform an evaluation of data produced by Phi3 (Ollama) using GPT3.5. But I want to perform an evaluation with an open-source model, without the need for Internet. Cheers!

Commented on Integrating LiteLLM with Llama_index: Seeking MWE...·Posted inPhoenix Support

Gordon E.

I was able to get relevance, correctness, and hallucinations, which is good. But I had to use GPT3.5 for this. I still want to be able to use an Open Source model.

Commented on Integrating LiteLLM with Llama_index: Seeking MWE...·Posted inPhoenix Support

Gordon E.

A MWE would be appreciated. If it is possible to use a non-openAI model, that would be even better. Thanks.

Commented on Integrating LiteLLM with Llama_index: Seeking MWE...·Posted inPhoenix Support

Gordon E.

Hi @mikyo! Yes, the error occurs when I call eval. But to make sure we are on the same page, I am attaching my code (short) and the error message (longer). Can you read the file (it is labelled binary but it is text). I realize that I can run outside Llama_index, but I thought that Phoenix was integrated into Llama_index. I thought that included evaluation. Thanks!

Posted in Phoenix Support·

Gordon E.

Integrating LiteLLM with Llama_index: Seeking MWE Example

I am trying to do an evaluation with Phoenix/Arize with Llama_index, but using an OpenSource model. LiteLLM is supposedly supported, but when I use it within Llama_index, I get errors such as field default_concurrency missing, and once I created such a field, the message reload-client missing. Needless to say, I must be doing something wrong or missing some important point. Can somebody please point me to, or provide me with, a MWE example using Llama_index and an open source model, with the use of an evaluator, for example, ” hallucination_evaluator = HallucinationEvaluator(model=eval_llm)” If I am posting in the wrong channel, I apologize. Gordon

10Comments