Почетна Преглед Помоћ
Пријавите се
tomteb
/
carbon-lang
1
0
Креирај огранак 0
Датотеке Дискусије 0 Захтеви за спајање 0 Вики
Дрво: e343ea593c
Гране Ознаке
carbon-lang
/
docs
/
design
/
lexical_conventions
josh11b 58c106010c Updates to design docs to reflect accepted proposals (#3254) пре 2 година
..
README.md 6d399c80b0 Added info on symbolic tokens in design docs (#2657) пре 2 година
comments.md 33f26bd37b Added design of comments in design docs (#2641) пре 3 година
numeric_literals.md 2e7ce09c34 Explicit 'one or more' for digits in non-decimal integers. (#2936) пре 2 година
string_literals.md c974a77314 Added newline example and clarifications for string_literals.md (#2966) пре 2 година
symbolic_tokens.md 58c106010c Updates to design docs to reflect accepted proposals (#3254) пре 2 година
whitespace.md b7df523dc8 Fix cross-file links in non-proposal files (#1010) пре 4 година
words.md 1cab6920f2 Treesitter parser (#2902) пре 2 година

README.md

Lexical conventions

Table of contents

Lexical elements

The first stage of processing a source file is the division of the source file into lexical elements.

A lexical element is one of the following:

The sequence of lexical elements is formed by repeatedly removing the longest initial sequence of characters that forms a valid lexical element.