I'm wondering about the default setting for the maximum number of tokens allowed in GPT-4. I want to know the limit for the text generation in GPT-4.
5 answers
KimonoElegant
Fri Nov 22 2024
GPT-4o max tokens have a default limit of 4091.
WhisperEcho
Thu Nov 21 2024
This means that only 6 new websocket connections can be established every minute for the gpt-4o-realtime-preview feature.
Tommaso
Thu Nov 21 2024
The current rate limits for the real-time audio feature, known as gpt-4o-realtime-preview, are determined by the number of new websocket connections allowed per minute.
BonsaiBeauty
Thu Nov 21 2024
These rate limits are crucial for maintaining the smooth functioning of the service and ensuring that all users have access to it without any disruptions.
Martino
Thu Nov 21 2024
Specifically, the rate limit is set at 6 requests per minute (RPM).