Arize AI Community Icon

Home
Events

Arize AX Releases
Arize AX Support
Arize News
Arize Observe
Discussions
Introductions
Phoenix Support

Powered by Tightknit

Phoenix Support

Phoenix Support

AWS Bedrock and Arize AI Phoenix Token Format Issues

·Nov 12, 2024 05:55 AM

i just connect aws bedrock with arize ai phoenix but the token are not been shown i don't understand why i think it due to the format the token are in but i don't know how would i change the format to get the token can you help me with this thnx

2 comments

· Sorted by Oldest

RunLLM
APP
·
The issue with tokens not being displayed in Phoenix when using AWS Bedrock might be related to how the token data is being captured and passed. According to the GitHub issue, token counts for Bedrock models are not captured by default. This is labeled as an enhancement request, indicating that the current implementation may not support token capture for Bedrock models.To address this, ensure that your implementation correctly formats and sends token data to Phoenix. You may need to manually instrument your application to capture token information and pass it to Phoenix using the appropriate attributes. If you are using OpenTelemetry, ensure that the token data is included in the span attributes and that the Phoenix backend is configured to process these attributes.Would you like more detailed guidance on how to manually instrument your application for token capture?Sources: - GitHub issue
💡 Hint: Mention RunLLM in the thread for followups.
Xander S.
·
hey Mohit V., which bedrock model are you using? can you provide a minimal working example to reproduce?