Using Phoenix Framework on AWS Lambda with EFS Storage

Adam D. · 2024-01-23T14:25:35.264Z

is there any way to use Phoenix on Lambda ? Perhaps there is a way to store the DB on an EFS mount ?

Dustin N.
·
Hi Adam D., EFS mounts are on our roadmap but for now you can use a Phoenix image from dockerhub. Would you mind sharing a little bit about how you're hoping to use a lambda-based solution?
Jason
·
We are talking through a lot of options and likely some options are imminent. Direction we are headed - Essentially the LLM tracer runs on Lambda and can persist to 3 options (EFS, Cloud bucket or Table). Phoenix or Arize cloud can be brought up on those openinference Trace files Adam D. Would cloud bucket be better or worse than EFS?
Adam D.
·
i want to enable traces on a lambda function running LlamaIndex but obv lambda functions dont keep their drives aorund so trying to see how to persist the data for a Lambda
Adam D.
·
i imagine S3 bucket would be easier for users overall (but we do happen to use EFS)
Dustin N.
·
Thanks for the info Adam D.! From what you're describing you can consider running the Phoenix application separately from the tracing and instrumentation inside Lambda. The Phoenix server acts as our collector for traces and doesn't need to be ephemeral. Once that's set up you can configure the trace exporters to point to the collector. More info can be found here: https://docs.arize.com/phoenix/reference/environments#container
Dustin N.
·
Here's more info on deploying Phoenix: https://docs.arize.com/phoenix/concepts/deploying-phoenix
Adam D.
·
oh thats super helpful
Adam D.
·
So to run the app server , all i need to do is ..
import phoenix as px session = px.launch_app()
?
Adam D.
·
when i do that, the app just dies after running that command, should it loop or do i need to throw it into a while True: loop
Dustin N.
·
what error are you getting?
Adam D.
·
it just exits , i thought it would auto run in the background

# cat main.py
import phoenix as px
session = px.launch_app()

Adam D.

# python main.py
🌍 To view the Phoenix app in your browser, visit http://localhost:6006/
📺 To view the Phoenix app in a notebook, run `px.active_session().view()`
📖 For more information on how to use Phoenix, check out https://docs.arize.com/phoenix
[root@app]#

Dustin N.
·
I'll look into this, for now try running it inside an ipython shell?
Adam D.
·
have not used ipython before, will take a look

60 comments