Hey Shai K., just to clarify, it sounds like you want to run a single experiment in which each example is evaluated more than once. If so, it sounds like you're after repetitions, which is a feature we have yet to implement in the experiments SDK.
Please feel free to upvote and follow this GitHub issue for updates.
https://github.com/Arize-ai/phoenix/issues/3584
