COMPUTER SCIENCE AND ENGINEERING
COMPILER DESIGN
|
Question
[CLICK ON ANY CHOICE TO KNOW THE RIGHT ANSWER]
|
|
|
keywords
|
|
|
operators
|
|
|
identifiers
|
|
|
punctuation marks
|
Detailed explanation-1: -Punctuation is treated as a token separate from word tokens and number tokens. Bounding punctuation, like commas (, ) and apostrophes (’), are treated as their own tokens. Sequential punctuation, like the dash (rendered as-in VEP SimpleText) and ellipses (…), is grouped together as one token.
Detailed explanation-2: -What are the 14 Punctuation Marks in English? There are 14 punctuation marks that are used in the English language. They are: the period, question mark, exclamation point, comma, colon, semicolon, dash, hyphen, brackets, braces, parentheses, apostrophe, quotation mark, and ellipsis.
Detailed explanation-3: -Explanation: The main punctuation marks are full stop, comma, colon, semicolon, question mark, exclamation mark, hyphen, dash, brackets, apostrophe. Hashtag isn’t a punctuation mark.