Token
T
Token
Definition
The small unit of text — roughly a word or part of a word — that language models read and generate. Longer inputs and outputs use more tokens.