Tokens are the basic units AI models use to process text. They can be whole words, parts of words, numbers or punctuation.