To address the issue of tokens not being displayed when connecting AWS Bedrock with Arize AI Phoenix, ensure that the token count data is correctly formatted and passed to Phoenix. According to the test_instrumentor.py, the token counts should be included in the span attributes using LLM_TOKEN_COUNT_PROMPT, LLM_TOKEN_COUNT_COMPLETION, and LLM_TOKEN_COUNT_TOTAL. Ensure these attributes are correctly set in your implementation.
If the token counts are not appearing, verify that the response from AWS Bedrock includes the token count headers (x-amzn-bedrock-input-token-count and x-amzn-bedrock-output-token-count) and that these values are being extracted and passed to Phoenix. If you need more detailed guidance, let me know.
Sources:
- test_instrumentor.py
