What is a token, and how many tokens can Perplexity read at once?
A token is a small unit of text, like a chunk of a word, that Perplexity reads and writes one at a time. Perplexity can remember prior questions and answers within a context window, which is measured in tokens.
By default, Perplexity reads up to 4,000 tokens per query. For longer inputs, such as pasted text, Perplexity will convert the text into a file to process more content.
Perplexity Pro subscribers unlock extended context windows, allowing up to 32,000 tokens per query when uploading files, powered by GPT-4 Omni or Claude 3.5 Sonnet. Additionally, GPT-4 Omni and Claude 3.5 Sonnet can generate responses up to 4,000 tokens in length.
