Issue with LLM Trace Token Count for Llama Model

·Mar 11, 2024 06:41 AM

Hi Arize team I have a doubt.I am trying out LLM Trace with llama model and but I am not getting the count of tokens.Its always giving token count as zero.Please look into it

Arize AX Support

Issue with LLM Trace Token Count for Llama Model

Roshan J.

·Mar 11, 2024 06:41 AM

Hi Arize team I have a doubt.I am trying out LLM Trace with llama model and but I am not getting the count of tokens.Its always giving token count as zero.Please look into it