This component would be in the Arize Core platform, app.arize.com for reference; you can upload that data with this SDK https://docs.arize.com/arize/large-language-models/tracing/log-as-inferences
If its possible to pass over the head of the DF (or mocked up data for privacy), I can look at it and give you a sample notebook to help you with the ingestion.
Hi! I can help out.
Yes - are these values like input tokens already logged in a DF or like a file?
If so, we can consume them and spin up a very simple dashboard with widgets to provide counts, averages and if needed, filtered or groupby.
Or if you need tooling to also generate and capture that data, we can use our tracers to capture these details.
Relevant documentation - https://docs.arize.com/arize/large-language-models/production-monitoring/token-counting
Are you free to hop on a quick call for us to pair on these items?
