Displaying Anthropic Tool Calls in Chat Messages: A Guide

Rusty · 2024-12-20T16:20:22.787Z

Is there a way to display Anthropic tool calls in chat messages similar to OpenAI tool calls?

Displaying Anthropic Tool Calls in Chat Messages: A Guide | Arize AI Community

14 comments

· Sorted by Oldest

RunLLM
APP
·
Yes, Phoenix supports displaying Anthropic tool calls in chat messages. According to the GitHub pull request, Phoenix has implemented support for Anthropic tool messages by allowing users to add tool results to chats as "role: tool" messages. This implementation ensures that tool calls are properly instrumented and displayed in the chat interface, similar to OpenAI tool calls.Would you like more detail on how this is implemented?Sources: - GitHub pull request
💡 Hint: Mention RunLLM in the thread for followups.
Rusty
·
It seems like that PR was focused on the playground?
Rusty
·
We're currently running 7.0.1, and this is what I'm seeing:
Rusty
·
Those two FunctionTool.acall's were triggered by that Anthropic.achat
Mikyo
·
Hey 🔒[private user] are you using LangChain or CrewAI? We might have not covered that ground quite yet. Can you let 🔒[private user] 🔒[private user] and I know your setup? Happy to get it prioritized!
Rusty
·
This is with Llama Index 👍🏻
Rusty
·
With OpenAI, we see something like this:
Rusty
·
Even with OpenAI, the actual output is blank. I think since the LLM is only making a tool call.
Rusty
·
Looking at "input" of a later call in the workflow, I can see the tool call information (in both the OpenAI case and Anthropic case)
Rusty
·
OpenAI:
"ChatMessage(role=<MessageRole.ASSISTANT: 'assistant'>, additional_kwargs={'tool_calls': [ChatCompletionMessageToolCall(id='call_RUIL4vYzqq8GPfjrAU828A9x', function=Function(arguments=...
Anthropic: "ChatMessage(role=<MessageRole.ASSISTANT: 'assistant'>, additional_kwargs={'tool_calls': [ChatCompletionMessageToolCall(id='call_upXdw9LIwxbWrLHG95IOau9y', function=Function(arguments=...
Rusty
·
Does that help? LMK if you want more details.

Rusty

Actually I copied an OpenAI example twice. 🤦🏻 This is an Anthropic example for above:

"ChatMessage(role=<MessageRole.ASSISTANT: 'assistant'>, additional_kwargs={'tool_calls': [{'id': 'toolu_01MeY9woeX12dn5PQ62skjnZ', 'input': {...

Rusty
·
Oh awesome, thanks! Just tried it out and it's working 👍🏻
2
Mikyo
·
Thanks for the feedback and helping us improve the product! glad we could help.
😄1

RunLLM
APP
·
Yes, Phoenix supports displaying Anthropic tool calls in chat messages. According to the GitHub pull request, Phoenix has implemented support for Anthropic tool messages by allowing users to add tool results to chats as "role: tool" messages. This implementation ensures that tool calls are properly instrumented and displayed in the chat interface, similar to OpenAI tool calls.Would you like more detail on how this is implemented?Sources: - GitHub pull request
💡 Hint: Mention RunLLM in the thread for followups.
Rusty
·
It seems like that PR was focused on the playground?
Rusty
·
We're currently running 7.0.1, and this is what I'm seeing:
Rusty
·
Those two FunctionTool.acall's were triggered by that Anthropic.achat
Mikyo
·
Hey 🔒[private user] are you using LangChain or CrewAI? We might have not covered that ground quite yet. Can you let 🔒[private user] 🔒[private user] and I know your setup? Happy to get it prioritized!
Rusty
·
This is with Llama Index 👍🏻
Rusty
·
With OpenAI, we see something like this:
Rusty
·
Even with OpenAI, the actual output is blank. I think since the LLM is only making a tool call.
Rusty
·
Looking at "input" of a later call in the workflow, I can see the tool call information (in both the OpenAI case and Anthropic case)
Rusty
·
OpenAI:
"ChatMessage(role=<MessageRole.ASSISTANT: 'assistant'>, additional_kwargs={'tool_calls': [ChatCompletionMessageToolCall(id='call_RUIL4vYzqq8GPfjrAU828A9x', function=Function(arguments=...
Anthropic: "ChatMessage(role=<MessageRole.ASSISTANT: 'assistant'>, additional_kwargs={'tool_calls': [ChatCompletionMessageToolCall(id='call_upXdw9LIwxbWrLHG95IOau9y', function=Function(arguments=...
Rusty
·
Does that help? LMK if you want more details.

Rusty

Actually I copied an OpenAI example twice. 🤦🏻 This is an Anthropic example for above:

"ChatMessage(role=<MessageRole.ASSISTANT: 'assistant'>, additional_kwargs={'tool_calls': [{'id': 'toolu_01MeY9woeX12dn5PQ62skjnZ', 'input': {...

Rusty
·
Oh awesome, thanks! Just tried it out and it's working 👍🏻
2
Mikyo
·
Thanks for the feedback and helping us improve the product! glad we could help.
😄1