I want to understand how tokens per minute (TPM) are calculated. I'm looking for an explanation of the process or formula used to determine this metric.
6 answers
CosmicDreamWhisper
Sat Nov 23 2024
Tokens per minute (TPM) are calculated for billing purposes based on a specific methodology.
Margherita
Sat Nov 23 2024
This methodology involves averaging the number of tokens used over 15-minute intervals.
SejongWisdomSeeker
Sat Nov 23 2024
These intervals are aligned to the top of the hour, such as from 3:00 to 3:15, and then from 3:15 to 3:31.
mia_harrison_painter
Sat Nov 23 2024
If, within any given 15-minute period, the total tokens used are below your Scale Tier entitlement.
MountFujiVista
Fri Nov 22 2024
You will not be billed for those tokens during that specific interval.