Expand description
The Cove lexer.
Converts one source file into a flat token stream. Lexing never panics on
malformed input: every lexical error is collected as a [Diagnostic] and
the lexer recovers by skipping the offending text, so a single call to
lex can report every problem in a file at once.
Functionsยง
- lex
- Lexes
fileout ofsourcesinto a token stream. - lex_
recovered - Lexes
fileand answers both halves of what the lexer found: the tokens it recovered and everything it complained about.