|
|
před 2 roky | |
|---|---|---|
| .. | ||
| README.md | 6d399c80b0 Added info on symbolic tokens in design docs (#2657) | před 2 roky |
| comments.md | 33f26bd37b Added design of comments in design docs (#2641) | před 3 roky |
| numeric_literals.md | 2e7ce09c34 Explicit 'one or more' for digits in non-decimal integers. (#2936) | před 2 roky |
| string_literals.md | c974a77314 Added newline example and clarifications for string_literals.md (#2966) | před 2 roky |
| symbolic_tokens.md | 2cf5ab155b Fix copy-paste error in name of pull request (#2871) | před 2 roky |
| whitespace.md | b7df523dc8 Fix cross-file links in non-proposal files (#1010) | před 4 roky |
| words.md | 1cab6920f2 Treesitter parser (#2902) | před 2 roky |
The first stage of processing a source file is the division of the source file into lexical elements.
A lexical element is one of the following:
a literal:
a comment
The sequence of lexical elements is formed by repeatedly removing the longest initial sequence of characters that forms a valid lexical element.