Chapter 4: Tokens??

Tokens are the smallest meaningful part of the source code ( the high level language). So if your language contains if keyword it should have a token “IF” that would allow the compiler to identify the stream of characters in a source code and then se...