Glossary
Token-based pricing — Glossary
Billing model inference by the number of tokens processed in prompts and completions.
Full definition
Providers meter input and output tokens as a proxy for compute. Architectures that stuff large contexts on every call can dominate cost; caching and retrieval help.