Very compelling arguments towards building agentic applications on top of typescript. Durable Objects in particular are such a game changer, imagine giving your Agent the power to spin up compute resources on demand without fear of cost, or triggering crons so that it can "wake up", think, and spawn more actions throughout the day. https://sunilpai.dev/posts/cloudflare-workers-for-ai-agents/
A good amount of this isn't specific to cloudflare either, https://val.town offers similar capabilities in terms of firing up ephemeral typescript processes on demand/schedule
Giving an agent access to a browser seems a pretty compelling use-case.
Is ts serverless boot time trivial these days?
It depends on the platform but both durable objects and val town are sub 1 second IIRC
valtown based on deno, and durable objects based on cloudflare worker runtime
I need to play with cloudflare - didn't realize they had a llm gateway
My favorite use case for cloudflare right now is spinning up an ephemeral agent inside of durable object when a user joins a chat room; From there the agent has access to the same event stream as a normal user and can take whatever actions it would like on the chat room
Is this related to partykit or is it something completely different?
Partykit is a convenience wrapper based on top of durable objects, which are little disposable compute objects that have websocket capabilities, making them really nice for realtime use in chatrooms, drawing spaces, etc
Can spin up one per-user and each DO can spin up ancillary objects if you want, the scale is hard to believe until you try it out
Wild. Just reading the docs - https://developers.cloudflare.com/durable-objects/get-started/walkthrough/ Makes sense.
Preview your Durable Object Worker at <YOUR_WORKER>.<YOUR_SUBDOMAIN>.workers.dev.
It's funny how infra and devops converges on javascript. I guess it's inevitable as they say
sandboxing is powerful stuff
Speaking of - codesandox. Bought by together.ai I think.
super interesting acquisition. as a long time user of codesandbox I think they got stuck in a bad place between stackblitz, valtown, and all of these faster and more specialized code-in-the-cloud platforms
