Yes, you can access token counts for specific traces via code by extracting the `llm.token_count.prompt` (input tokens) and `llm.token_count.completion` (output tokens) attributes from the relevant spans. These attributes are available if your instrumentation or provider supplies them, and you can retrieve them programmatically from the span data in Phoenix or via the OpenInference conventions in your tracing code. For example, in Python, you can access these attributes from the span object or the exported trace data as shown in the documentation and code examples. If you use OpenInference auto-instrumentation with supported providers (like OpenAI or Anthropic), token counts are automatically included in the trace spans and can be queried directly in your code or exported for analysis. For manual instrumentation, ensure you log these attributes on your spans for later retrieval.
For more details, see the <https://arize.com/docs/phoenix/tracing/how-to-tracing/cost-tracking|Phoenix cost tracking documentation> and <https://github.com/Arize-ai/openinference/blob/main/spec/semantic_conventions.md|OpenInference semantic conventions>. Would you like a code example for extracting these values from a trace?
Sources:
- <https://arize.com/docs/phoenix/tracing/how-to-tracing/cost-tracking|Phoenix cost tracking documentation>
- <https://github.com/Arize-ai/openinference/blob/main/spec/semantic_conventions.md|OpenInference semantic conventions>
- <https://arize-ai.slack.com/archives/C04R3GXC8HK/p1721279912.874629|Slack discussion on token counts>
