There are several kinds of tokens: identifiers, keywords, literals, operators, and punctuators. White space and comments are not tokens, though they act as separators for tokens. token :: identifierkeywordinteger-literalreal-literalcharacter-literalstring-literaloperator-or-punctuator