Juan C. The playground can be great to replay specific examples:
- 1.
Retrieval is done, text is returned
- 2.
Based on retrieved context call an LLM
Are you using a framework or all hand coded?
Phoenix doesn't run your application itself but If you trace your application you can replay specific retrieval events based on your returned data. We don't replay the search itself, but can replay the data post search and allow you to vary the template.
The key is that you use prompt variables and template together. The variables will be the data that is returned from the search index. This allows you to edit your prompt template and replay the response from the retrieval based on the same data.
