Hi, I'm trying to run the phoenix server using px.launch_app inside a while loop to keep it alive, I'm doing this because I want the inferences(model page) to be shown on the UI with tracing and evaluation. Code which I'm using is as follows:
# create `inference_df` and `trace_dataset` before loop
while True:
px.close_app()
px.launch_app(inference_df, trace=trace_dataset, port=6006, host="0.0.0.0")Is there an optimized way to run the server with updating inferences and experience zero-downtime?
Morning Anuraag T. - the code you pasted I'm afraid will make phoenix thrash up and down. The while true loop would simply be to keep the main thread alive so the launch_app should be outside and you should only have a sleep inside the wile loop. On the support for inferences, Phoenix is now mainly supporting traces and will not be actively working on inference storage in the coming months. The arize platform does support logging inferences and maintaining your vectors so I'd definitely check out Arize AX Support if that is something you are interested in.
