Issue with Token Count for LangGraph Queries

·Jun 25, 2024 07:20 AM

Hi Mikyo I am facing the same issue stated below https://github.com/Arize-ai/openinference/issues/532 I am not getting the tokens count for the langgraph queries.Is it a valid issue or am I missing something.?

8 comments

· Sorted by Oldest

Mikyo
·
It's probably un-related DSPy if it's langraph. Would you mind filing another ticket with as much info as you can? LLM, versions, code etc.? Sorry you're facing issues. Appreciate the heads up and helping us roll out speedy fixes for langraph.
Ruchika B.
·
Hi I am using open AI GPT and have the langgraph version==0.0.32. for referance you can see this collab https://colab.research.google.com/drive/1xDEPe2i_2rRqs7o6oNTtqA4J7Orsnvx1?usp=sharing I won't be able to share my code
Mikyo
·
Thanks Ruchika - could you do me one favor and make sure you have token count reporting setup using OpenAI? https://docs.arize.com/phoenix/tracing/faqs-tracing#for-openai-how-do-i-get-token-counts-when-streaming
Mikyo
·
Here's the issue for reference. Would love your help on fleshing out the details (https://github.com/Arize-ai/openinference/issues/545) Thanks again.
Ruchika B.
·
Hi regarding the token count Can this statement be an issue bcoz I am following one Colab https://colab.research.google.com/drive/1xDEPe2i_2rRqs7o6oNTtqA4J7Orsnvx1?usp=sharing Here it is used as from openinference.instrumentation.langchain import langchaininstrumentor But I am using from Phoenix.trace.langchain import langchaininstrumentor And I am not able to get the token count And aslo I m not able to run the code using From openinference.instrumentation.langchain import langchaininstrumentor. Can you plz help me on this. I really need the token count think work.
Mikyo
·
Hi Ruchica. Thanks for the notebook - will take a look when I have some down time. Thank you! 🙏
Ruchika B.
·
Hi John, Thanks for the help but i have resolved the issue.
Ruchika B.
·
While configuring llm I have made streaming true changing it to false gave me the token count