LLM Tracing Issues with RAG App: Need Help Troubleshooting

Nitin M. · 2025-01-17T23:10:42.728Z

Hello 👋 I need help with LLM tracing for a simple RAG app. • i followed all instructions to get started with LLM tracing here: https://docs.arize.com/arize/llm-tracing/quickstart-llm • it worked well and i was able to see that a project was automatically created on the phoenix console and i was able to view tracking for the simple chat completion call to OpenAI. • now i built a rag interface and did whatever was necessary to trace. however, i'm not able to view traces on phoenix console. code is here (https://github.com/nitinm21/arize_project) (i've just removed the .env file that contains OpenAI key). can you please let me know what i'm doing wrong? Thank you!

LLM Tracing Issues with RAG App: Need Help Troubleshooting | Arize AI Community

13 comments

· Sorted by Oldest

Xander S.
·
Hey Nitin M., are you trying to use Phoenix or the Arize SaaS platform?
Nitin M.
·
Arize SaaS, sorry for the miscommunication
Xander S.
·
No worries, thanks for clarifying!
Xander S.
·
Are you trying to use a library or particular package?

Nitin M.

here's everything i imported

import os
import openai
from dotenv import load_dotenv
from flask import Flask, request, jsonify, render_template
from sentence_transformers import SentenceTransformer, util
from bs4 import BeautifulSoup
import requests
from arize.otel import register
from openinference.instrumentation.openai import OpenAIInstrumentor

Xander S.
·
Do you mind sending a full code snippet to reproduce?
Nitin M.
·
https://github.com/nitinm21/arize_
Xander S.
·
There's nothing that immediately stands out to me as problematic. As a first step, you might try adding a ConsoleSpanExporter to the tracer_provider to ensure that telemetry data is actually being emitted. You can see an example on this line.

Nitin M.

it still didn't work. here's what i changed

# Import necessary dependencies
import os
import openai
from dotenv import load_dotenv
from flask import Flask, request, jsonify, render_template
from sentence_transformers import SentenceTransformer, util
from bs4 import BeautifulSoup
import requests
from openinference.instrumentation.openai import OpenAIInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor


load_dotenv()
OPENAI_API_KEY = os.getenv("OPENAI_API_KEY")
openai.api_key = OPENAI_API_KEY

from arize.otel import register

# OpenTelemetry setup
tracer_provider = register(
    space_id="X==",  # Replace with actual Space ID
    api_key="X",       # Replace with actual API Key
    project_name="Arize_Nitin",           # Replace with your project name
)

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))
OpenAIInstrumentor().instrument(tracer_provider=tracer_provider)

# Initialize Flask app
app = Flask(__name__)

Xander S.
·
Do you see traces being logged to stdout?
Nitin M.
·
the application is working fine
Xander S.
·
ConsoleSpanExporter will print to stdout
Xander S.
·
You should see some printed traces in your logs each time a span is created.

Xander S.
·
Hey Nitin M., are you trying to use Phoenix or the Arize SaaS platform?
Nitin M.
·
Arize SaaS, sorry for the miscommunication
Xander S.
·
No worries, thanks for clarifying!
Xander S.
·
Are you trying to use a library or particular package?

Nitin M.

here's everything i imported

import os
import openai
from dotenv import load_dotenv
from flask import Flask, request, jsonify, render_template
from sentence_transformers import SentenceTransformer, util
from bs4 import BeautifulSoup
import requests
from arize.otel import register
from openinference.instrumentation.openai import OpenAIInstrumentor

Xander S.
·
Do you mind sending a full code snippet to reproduce?
Nitin M.
·
https://github.com/nitinm21/arize_
Xander S.
·
There's nothing that immediately stands out to me as problematic. As a first step, you might try adding a ConsoleSpanExporter to the tracer_provider to ensure that telemetry data is actually being emitted. You can see an example on this line.

Nitin M.

it still didn't work. here's what i changed

# Import necessary dependencies
import os
import openai
from dotenv import load_dotenv
from flask import Flask, request, jsonify, render_template
from sentence_transformers import SentenceTransformer, util
from bs4 import BeautifulSoup
import requests
from openinference.instrumentation.openai import OpenAIInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor


load_dotenv()
OPENAI_API_KEY = os.getenv("OPENAI_API_KEY")
openai.api_key = OPENAI_API_KEY

from arize.otel import register

# OpenTelemetry setup
tracer_provider = register(
    space_id="X==",  # Replace with actual Space ID
    api_key="X",       # Replace with actual API Key
    project_name="Arize_Nitin",           # Replace with your project name
)

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))
OpenAIInstrumentor().instrument(tracer_provider=tracer_provider)

# Initialize Flask app
app = Flask(__name__)

Xander S.
·
Do you see traces being logged to stdout?
Nitin M.
·
the application is working fine
Xander S.
·
ConsoleSpanExporter will print to stdout
Xander S.
·
You should see some printed traces in your logs each time a span is created.