LEXICAL ANALYSIS
ROLE OF THE LEXICAL ANALYZER
|
Question
[CLICK ON ANY CHOICE TO KNOW THE RIGHT ANSWER]
|
|
|
Lexeme
|
|
|
Lex
|
|
|
Either A or B
|
|
|
None of the above
|
Detailed explanation-1: -An individual token is called a) Lexeme. b) Lex. c) Lexeme & Lex. Explanation: Individual Token is also Called Lexeme.
Detailed explanation-2: -Token: A token is a group of characters having collective meaning: typically a word or punctuation mark, separated by a lexical analyzer and passed to a parser. A lexeme is an actual character sequence forming a specific instance of a token, such as num.
Detailed explanation-3: -Explanation: A lexeme is a string of characters that form a syntactic unit.
Detailed explanation-4: -A Token is a syntactic category that forms a class of lexemes. These are the “nouns", “verbs", and other parts of speech for the programming language. In a practical programming language, there are a very large number of lexemes, perhaps even an infinite number.
Detailed explanation-5: -A lexical token may consist of one or more characters, and every single character is in exactly one token. The tokens can be keywords, comments, numbers, white space, or strings. All lines should be terminated by a semi-colon (; ).