Yeah, apologies, I’m being pretty vague about what I’ve built 🙂
Basically, some AI process runs on a bunch of queued data, say it produces a summary for each record. I currently store info about the phoenix prompt version used for the summary. If the record is re-queued, and a summary already exists with the existing ‘production’ tagged prompt, we just return the already created summary.
Say I update my prompt, because I like what it outputs better, and set that new version to production. My pipeline would need to generate new summaries since no summaries exist using the new production prompt (nothing to get from our DB / caching system).
But, if I was able to check in Phoenix for prompt versions that are still labeled ‘valid’, I could give the system calling me an already generated summary. It’d also give me control of dropping old versions of prompts.
Make sense? Again, the problem and solution might be niche, but I’m willing to implement it.
