Arize AI Community Icon

Home
Events

Arize AX Releases
Arize AX Support
Arize News
Arize Observe
Discussions
Introductions
Phoenix Support

Powered by Tightknit

Phoenix Support

Targeted Instrumentation in Llama-Index Applications Explained | Arize AI Community

Phoenix Support

Targeted Instrumentation in Llama-Index Applications Explained

·Nov 07, 2024 01:11 PM

Hi, I'm currently using a global trace provider to instrument my llama-index application (image). Is there a way of instead of using global instrumentation, do targeted instrumentation? example: I have 2 separate llama-index workflows, but I want only one to send spans to phoenix.

3 comments

· Sorted by Oldest

RunLLM
APP
·
To achieve targeted instrumentation for specific workflows in your LlamaIndex application, you can use the OpenInferenceTraceCallbackHandler to instrument only the parts you want. Instead of setting a global handler, attach handlers to specific workflows. This allows you to selectively send spans to Phoenix for only the desired workflows.Here's a basic example of how you might set this up: ```from openinference.instrumentation.llama_index._callback import OpenInferenceTraceCallbackHandler# Initialize the handler for the specific workflow handler = OpenInferenceTraceCallbackHandler()# Attach the handler to the specific workflow you want to instrument workflow_1.attach_handler(handler)# Do not attach the handler to the other workflow
- Slack Discussion
💡 Hint: Mention RunLLM in the thread for followups.
Roger Y.
·
I don’t think this is possible right now, but it’s something we can investigate. Would you mind opening an enhancement request to provide some details for us to track?
👍1
Arthur M.
·
Leaving this here for future slack searchers. There's a way of accomplish this today. https://github.com/Arize-ai/phoenix/issues/5293#issuecomment-2467460740 Thanks Roger Y.
1