Share feedback, ideas and get community help

Updated 4 months ago

Request limit/TPS

At a glance

A community member reported issues with a Typebot automation freezing during a batch test of 170 people. The problem occurred when the automation included OpenAI requests to check users' gender based on their names. Users experienced stalling when trying to proceed through the automation, with the system returning to the "continue" button repeatedly.

Through discussion in the comments, it was revealed that the issue wasn't related to Typebot's server capacity but rather to OpenAI's rate limits, as evidenced by a 429 error (too many requests per minute) in the logs. While specific TPS (Transactions Per Second) information for Typebot Cloud wasn't available, the problem was identified as an OpenAI rate limiting issue rather than a Typebot performance problem.

Useful resources
I recently encountered an issue while processing a batch test of 170 people through a Typebot automation and it froze several times. To better understand and optimize the system, I wonder if anyone can provide information on the system's capacity limitations, specifically in terms of Transactions Per Second (TPS) or any request limits that might be in place? I want to ensure that the system can handle the desired load without encountering performance issues.
B
F
8 comments
What do you mean by « froze »? What do you see exactly? What do you monitor?
This is the video of a user trying to enter his name.
Under the name block I had a OpenAi request to check the user gender using the user's name. It would not go through.

In the end of the automation the bot also wouldn't load and the same thing would happen, the user would press "continue" and the automation would stall and go back to the "continue" button
Have you checked the logs for that particular session? https://docs.typebot.io/results/overview#logs
I did, I got a 429 error from OpenAI request, which is the too many request per minute. However, I need to brief the CEO this week and I want to, in addition to showing the error I got from OpenAi, show what are the TPS on typebot servers. Can you provide that information?
Hmmm I don't have that info for Typebot Cloud. But it gets a lot of requests 😅à
So you've got the issue, it's not a load problem
Just a hitting rate limit on OpenAI's side
Thank you Baptiste!
Add a reply
Sign up and join the conversation on Discord