Character Set:
Python-এ valid characters-এর collection।
- Alphabets (A-Z, a-z)
- Digits (0-9)
- Special symbols (+, -, *, etc.)
- Whitespace
Tokens:
Tokens হলো program-এর smallest meaningful unit।
Types of Tokens:
- Keyword: Reserved word (if, else, for)
- Identifier: Variable/function নাম
- Literal: Fixed value (10, "hello")
- Operator: (+, -, *)
- Punctuator: (), {}, []