Lexeme
A meaningful linguistic unit that is an item in the vocabulary of a language. In a programming language this would include keywords, identifiers, literals and punctutation which are then passed to the parser for syntactic analysis.
A meaningful linguistic unit that is an item in the vocabulary of a language. In a programming language this would include keywords, identifiers, literals and punctutation which are then passed to the parser for syntactic analysis.