Hi Mikyo! Matt V. encouraged our team to connect with you. We have been eyeing the new Datasets and Experiments features, and there are a few features critical for our adoption:
A graph view of metrics over time
Ability to add ‘milestones’ to the graph - visual markers of significant changes to the AI application that would impact the metrics, e.g., usage of a new model.
Easy retrieval of all run experiments data via API or the SDK
Local authentication: Currently on the roadmap but timeline is unclear.
OAuth2: Listed as phase 3 in the authentication roadmap, but appears to be far in the future.
Could you please help us understand where these features fall on Phoenix's development timeline? Your assistance would be invaluable in helping us make an informed decision. Thanks!
