Issue with LLM Trace Token Count for Llama Model

·Mar 11, 2024 06:41 AM

Hi Arize team I have a doubt.I am trying out LLM Trace with llama model and but I am not getting the count of tokens.Its always giving token count as zero.Please look into it

1 comment

· Sorted by Oldest

Mikyo
·
Hey Roshan, right now we only report token counts for models that self-advertise the usage metrics - we don't report metrics otherwise. We will have a solution for this in the future. Sorry for the inconvenience.
👍1

Mikyo
·
Hey Roshan, right now we only report token counts for models that self-advertise the usage metrics - we don't report metrics otherwise. We will have a solution for this in the future. Sorry for the inconvenience.
👍1