Error with Optional Fields in LLMRunMetadata Logging to Arize
On a different note, I'm also getting an error when I don't pass the total_token_count to the LLMRunMetadata object when logging data to Arize, but the docs say that that value is optional?
line 296, in validate raise InvalidValueType( arize.utils.errors.InvalidValueType: total_token_count with value None is of type NoneType, but expected one of: int, floatis it correct that it is mandatory to pass when passing llm metadata to the log method? I have the same with the response_latency_ms. If I don't pass it I get this:
in request self.arize_client.log( File "/var/deployment_instance/venv/lib/python3.10/site-packages/arize/api.py", line 388, in log llm_run_metadata.validate() File "/var/deployment_instance/venv/lib/python3.10/site-packages/arize/utils/types.py", line 314, in validate raise InvalidValueType( arize.utils.errors.InvalidValueType: response_latency_ms with value None is of type NoneType, but expected one of: int, floatbut I don't want to log the latency because I can't really determine it from the point where I'm logging from