Scaling Lambda Functions: Message Limits and Timeouts Explained

·Aug 26, 2025 06:31 PM

Is there a limit to how many messages can be sent? Trying to scale up my llm to be running 10 lambdas with my code. This generates 22 spans and 36 evals and seeing a lot of timeouts. I added them to a queue in the lambda so I can process the message and give it a few retries.

1

2 comments

· Sorted by Oldest

Arize AX Support

Scaling Lambda Functions: Message Limits and Timeouts Explained

Paul D.

·Aug 26, 2025 06:31 PM

Is there a limit to how many messages can be sent? Trying to scale up my llm to be running 10 lambdas with my code. This generates 22 spans and 36 evals and seeing a lot of timeouts. I added them to a queue in the lambda so I can process the message and give it a few retries.

1

2 comments

· Sorted by Oldest

Paul D.
·
So the trace spans are working okay but the evals are timing out. When we are doing tests with 150ish items that each need the 36 evals we are running into timeouts. We are retrying these potentially 5 times and still seeing a large number not succesfully uploading. Can you please provide me how many evals can be uploaded a minute?
Paul D.
·
I messaged you with some additional details related to our account and the logs associated with it.

Paul D.
·
So the trace spans are working okay but the evals are timing out. When we are doing tests with 150ish items that each need the 36 evals we are running into timeouts. We are retrying these potentially 5 times and still seeing a large number not succesfully uploading. Can you please provide me how many evals can be uploaded a minute?
Paul D.
·
I messaged you with some additional details related to our account and the logs associated with it.