Connecting Phoenix with LlamaIndex: Best Practices and Recommendations

·Feb 24, 2024 10:17 PM

I've currently wired up to Phoenix from something written with LlamaIndex. Is that what you'd recommend still? or is there something more Llama native to do this?

5 comments

· Sorted by Oldest

Mikyo
·
I'm pretty confident we have the best telemetry for LlamaIndex Kurt T.. I also like that we are vendor agnostic, but I'm biased 😉 LlamaIndex doesn't have anything native, no.
Kurt T.
·
Thanks. I'll try that.
Kurt T.
·
(sorry... just to be clear: I was asking if the act of saving off the telemetry for later analysis by Phoenix.... if the saving off was best done using the open-tellemetry-python package, or if that could be done natively in LlamaIndex?) (or maybe... is open-telemetry also you guys?)
Mikyo
·
Yup, so we have a package called openinference-instrumentation-llama-index that converts llama-index callback data to open telemetry traces. So you can use anything in the OTEL ecosystem you want (like exporters in this case). Here’s like a full stack example https://github.com/Arize-ai/openinference/tree/main/python/examples/llama-index
Kurt T.
·
Thank you.
1

Mikyo
·
I'm pretty confident we have the best telemetry for LlamaIndex Kurt T.. I also like that we are vendor agnostic, but I'm biased 😉 LlamaIndex doesn't have anything native, no.
Kurt T.
·
Thanks. I'll try that.
Kurt T.
·
(sorry... just to be clear: I was asking if the act of saving off the telemetry for later analysis by Phoenix.... if the saving off was best done using the open-tellemetry-python package, or if that could be done natively in LlamaIndex?) (or maybe... is open-telemetry also you guys?)
Mikyo
·
Yup, so we have a package called openinference-instrumentation-llama-index that converts llama-index callback data to open telemetry traces. So you can use anything in the OTEL ecosystem you want (like exporters in this case). Here’s like a full stack example https://github.com/Arize-ai/openinference/tree/main/python/examples/llama-index
Kurt T.
·
Thank you.
1