Deploying Models with FastAPI and Integrating Observability Tools

Hi, new user here, lead data scientist at Graphext. I'm currently testing deploying our user's models on platforms like Fly.io via a simple FastAPI prediction server, and integrating observability platforms/APIs like Arize (and whylabs etc.) into our own server (such that predictions get automatically logged to Arize e.g.).