Thomas A.

E.g., right now I have some weird issue (in my program) where the LM is putting nonsensical sql into what should be a chain of though. So I want to see how I accidentally made a bad prompt or few-shot example. But because I've already run it once, it's cached, so it doesn't show up in Arize. I guess I could change a small character in the prompt or delete the cache. But it would be nice if it just showed up in Arize normally. Maybe with a small [cached] tag.

inspect_history will show me the last prompt/response, even if it was loaded from the cache

That's what I would love to replace with a UI tool like Arize

I normally use lm.inspect_history(n=1) to see the last message too/from the LM

Thank you!

Is it enough to simply import phoenix?

So how does it know to contact the server?