Self-hosting Phoenix in Kubernetes with Remote PostgreSQL DB

Kylix · 2025-05-16T03:28:06.141Z

Hello, Do anybody selfhost phoenix in Kubernetes deployments with a remote PostgreSQL DB? ( Selfhost and also in Kubernetes and postgres remote )

10 comments

· Sorted by Oldest

RunLLM
APP
·
Yes, Phoenix can be self-hosted in Kubernetes with a remote PostgreSQL database. You need to set the `PHOENIX_SQL_DATABASE_URL` environment variable in your deployment to point to your remote PostgreSQL instance (e.g., `postgresql://user:password@host:port/dbname`). The official documentation provides Kubernetes manifests and kustomize overlays for both SQLite and PostgreSQL backends, and recommends using PostgreSQL for production or multi-user scenarios. Migrations are handled automatically at startup, but ensure your database URL is correct and that the required dependencies (like `asyncpg`) are installed in your container image. For more details and example manifests, see the Kubernetes deployment guide and configuration docs (<https://docs.arize.com/phoenix/self-hosting/deployment-options/kubernetes|docs.arize.com>, <https://github.com/Arize-ai/phoenix/blob/main/docs/deployment/kubernetes.md|GitHub deployment docs>, <https://docs.arize.com/phoenix/self-hosting/configuration|configuration>). Would you like a step-by-step example manifest or troubleshooting tips? Sources: - <https://docs.arize.com/phoenix/self-hosting/deployment-options/kubernetes|Kubernetes Deployment Options> - <https://github.com/Arize-ai/phoenix/blob/main/docs/deployment/kubernetes.md|Phoenix Kubernetes Deployment Docs> - <https://docs.arize.com/phoenix/self-hosting/configuration|Phoenix Configuration> - <https://github.com/Arize-ai/phoenix/blob/main/docs/deployment/persistence.md|Persistence Docs> - <https://arize-ai.slack.com/archives/C04R3GXC8HK/p1715990445.892599|Slack Example>
💡 Hint: Mention RunLLM in the thread for followups.
Kylix
·
kustomize is not helpful for me 😞 in my setup.
Kylix
·
Hello Mikyo Please help on this.
Mikyo
·
Hey Kylix what does your manifest look like?
Mikyo
·
Not quite sure where you are stuck
Mikyo
·
Start here https://github.com/Arize-ai/phoenix/blob/main/kustomize/base/phoenix.yaml And add the Postgres overlay
Mikyo
·
RunLLM create a kubernetes manifest for Phoenix using PostGres
RunLLM
APP
·
To create a Kubernetes manifest for Phoenix using PostgreSQL, start with the base manifest and add the Postgres overlay. The recommended approach is to use kustomize overlays provided in the Phoenix repo. Clone the repo and apply the Postgres overlay: ``` git clone https://github.com/Arize-ai/phoenix.git kubectl apply -k kustomize/backends/postgres ``` This will deploy Phoenix configured to use a remote PostgreSQL database. You can customize the `PHOENIX_SQL_DATABASE_URL` in the overlay as needed (<https://github.com/Arize-ai/phoenix/blob/main/kustomize/base/phoenix.yaml|kustomize/base/phoenix.yaml>, <https://github.com/Arize-ai/phoenix/blob/main/kustomize/backends/postgres/patches.yaml|kustomize/backends/postgres/patches.yaml>). For manual editing, set the `PHOENIX_SQL_DATABASE_URL` environment variable in your manifest to your Postgres connection string. Would you like a full example manifest YAML? Sources: - <https://github.com/Arize-ai/phoenix/blob/main/docs/deployment/kubernetes.md|Phoenix Kubernetes Deployment Docs> - <https://github.com/Arize-ai/phoenix/blob/main/kustomize/backends/postgres/patches.yaml|kustomize/backends/postgres/patches.yaml> - <https://github.com/Arize-ai/phoenix/blob/main/kustomize/README.md|kustomize/README.md>
💡 Hint: Mention RunLLM in the thread for followups.
Mikyo
·
RunLLM yes, create a full manifest
RunLLM
APP
·
It seems likely that you can create a full Kubernetes manifest for Phoenix with PostgreSQL by combining the base manifest and adding the required environment variable for the Postgres connection. Below is an example manifest based on the official <https://github.com/Arize-ai/phoenix/blob/main/kustomize/base/phoenix.yaml|kustomize/base/phoenix.yaml> and <https://github.com/Arize-ai/phoenix/blob/main/kustomize/backends/postgres/patches.yaml|kustomize/backends/postgres/patches.yaml>: ``` apiVersion: v1 kind: Service metadata: name: phoenix labels: app: phoenix spec: ports: - port: 6006 protocol: TCP targetPort: 6006 - port: 4317 protocol: TCP targetPort: 4317 - port: 9090 protocol: TCP targetPort: 9090 selector: app: phoenix type: ClusterIP --- apiVersion: apps/v1 kind: StatefulSet metadata: name: phoenix spec: replicas: 1 selector: matchLabels: app: phoenix template: metadata: annotations: prometheus.io/path: /metrics prometheus.io/port: "9090" prometheus.io/scrape: "true" labels: app: phoenix spec: containers: - name: phoenix image: arizephoenix/phoenix:latest args: - -m - phoenix.server.main - serve command: - python env: - name: PHOENIX_PORT value: "6006" - name: PHOENIX_SQL_DATABASE_URL value: "postgresql://postgres:postgres@postgres:5432/postgres" ports: - containerPort: 6006 - containerPort: 4317 - containerPort: 9090 ``` You will also need a Postgres deployment/service, or point `PHOENIX_SQL_DATABASE_URL` to your remote instance. Adjust credentials and host as needed. Would you like a manifest for the Postgres database as well? Sources: - <https://github.com/Arize-ai/phoenix/blob/main/kustomize/base/phoenix.yaml|kustomize/base/phoenix.yaml> - <https://github.com/Arize-ai/phoenix/blob/main/kustomize/backends/postgres/patches.yaml|kustomize/backends/postgres/patches.yaml>
💡 Hint: Mention RunLLM in the thread for followups.

RunLLM
APP
·
Yes, Phoenix can be self-hosted in Kubernetes with a remote PostgreSQL database. You need to set the `PHOENIX_SQL_DATABASE_URL` environment variable in your deployment to point to your remote PostgreSQL instance (e.g., `postgresql://user:password@host:port/dbname`). The official documentation provides Kubernetes manifests and kustomize overlays for both SQLite and PostgreSQL backends, and recommends using PostgreSQL for production or multi-user scenarios. Migrations are handled automatically at startup, but ensure your database URL is correct and that the required dependencies (like `asyncpg`) are installed in your container image. For more details and example manifests, see the Kubernetes deployment guide and configuration docs (<https://docs.arize.com/phoenix/self-hosting/deployment-options/kubernetes|docs.arize.com>, <https://github.com/Arize-ai/phoenix/blob/main/docs/deployment/kubernetes.md|GitHub deployment docs>, <https://docs.arize.com/phoenix/self-hosting/configuration|configuration>). Would you like a step-by-step example manifest or troubleshooting tips? Sources: - <https://docs.arize.com/phoenix/self-hosting/deployment-options/kubernetes|Kubernetes Deployment Options> - <https://github.com/Arize-ai/phoenix/blob/main/docs/deployment/kubernetes.md|Phoenix Kubernetes Deployment Docs> - <https://docs.arize.com/phoenix/self-hosting/configuration|Phoenix Configuration> - <https://github.com/Arize-ai/phoenix/blob/main/docs/deployment/persistence.md|Persistence Docs> - <https://arize-ai.slack.com/archives/C04R3GXC8HK/p1715990445.892599|Slack Example>
💡 Hint: Mention RunLLM in the thread for followups.
Kylix
·
kustomize is not helpful for me 😞 in my setup.
Kylix
·
Hello Mikyo Please help on this.
Mikyo
·
Hey Kylix what does your manifest look like?
Mikyo
·
Not quite sure where you are stuck
Mikyo
·
Start here https://github.com/Arize-ai/phoenix/blob/main/kustomize/base/phoenix.yaml And add the Postgres overlay
Mikyo
·
RunLLM create a kubernetes manifest for Phoenix using PostGres
RunLLM
APP
·
To create a Kubernetes manifest for Phoenix using PostgreSQL, start with the base manifest and add the Postgres overlay. The recommended approach is to use kustomize overlays provided in the Phoenix repo. Clone the repo and apply the Postgres overlay: ``` git clone https://github.com/Arize-ai/phoenix.git kubectl apply -k kustomize/backends/postgres ``` This will deploy Phoenix configured to use a remote PostgreSQL database. You can customize the `PHOENIX_SQL_DATABASE_URL` in the overlay as needed (<https://github.com/Arize-ai/phoenix/blob/main/kustomize/base/phoenix.yaml|kustomize/base/phoenix.yaml>, <https://github.com/Arize-ai/phoenix/blob/main/kustomize/backends/postgres/patches.yaml|kustomize/backends/postgres/patches.yaml>). For manual editing, set the `PHOENIX_SQL_DATABASE_URL` environment variable in your manifest to your Postgres connection string. Would you like a full example manifest YAML? Sources: - <https://github.com/Arize-ai/phoenix/blob/main/docs/deployment/kubernetes.md|Phoenix Kubernetes Deployment Docs> - <https://github.com/Arize-ai/phoenix/blob/main/kustomize/backends/postgres/patches.yaml|kustomize/backends/postgres/patches.yaml> - <https://github.com/Arize-ai/phoenix/blob/main/kustomize/README.md|kustomize/README.md>
💡 Hint: Mention RunLLM in the thread for followups.
Mikyo
·
RunLLM yes, create a full manifest
RunLLM
APP
·
It seems likely that you can create a full Kubernetes manifest for Phoenix with PostgreSQL by combining the base manifest and adding the required environment variable for the Postgres connection. Below is an example manifest based on the official <https://github.com/Arize-ai/phoenix/blob/main/kustomize/base/phoenix.yaml|kustomize/base/phoenix.yaml> and <https://github.com/Arize-ai/phoenix/blob/main/kustomize/backends/postgres/patches.yaml|kustomize/backends/postgres/patches.yaml>: ``` apiVersion: v1 kind: Service metadata: name: phoenix labels: app: phoenix spec: ports: - port: 6006 protocol: TCP targetPort: 6006 - port: 4317 protocol: TCP targetPort: 4317 - port: 9090 protocol: TCP targetPort: 9090 selector: app: phoenix type: ClusterIP --- apiVersion: apps/v1 kind: StatefulSet metadata: name: phoenix spec: replicas: 1 selector: matchLabels: app: phoenix template: metadata: annotations: prometheus.io/path: /metrics prometheus.io/port: "9090" prometheus.io/scrape: "true" labels: app: phoenix spec: containers: - name: phoenix image: arizephoenix/phoenix:latest args: - -m - phoenix.server.main - serve command: - python env: - name: PHOENIX_PORT value: "6006" - name: PHOENIX_SQL_DATABASE_URL value: "postgresql://postgres:postgres@postgres:5432/postgres" ports: - containerPort: 6006 - containerPort: 4317 - containerPort: 9090 ``` You will also need a Postgres deployment/service, or point `PHOENIX_SQL_DATABASE_URL` to your remote instance. Adjust credentials and host as needed. Would you like a manifest for the Postgres database as well? Sources: - <https://github.com/Arize-ai/phoenix/blob/main/kustomize/base/phoenix.yaml|kustomize/base/phoenix.yaml> - <https://github.com/Arize-ai/phoenix/blob/main/kustomize/backends/postgres/patches.yaml|kustomize/backends/postgres/patches.yaml>
💡 Hint: Mention RunLLM in the thread for followups.