Makeup v0.5.0 Makeup.Lexer behaviour View Source

A lexer turns raw source code into a list of tokens.

Link to this section Summary

Callbacks

Lexes a string into a list of tokens

Matches groups in a list of tokens

Postprocesses a list of tokens before matching the contained groups

Parses the given string into a parsec result that inludes a list of tokens

Parses the smallest number of tokens that make sense. It’s a parsec

Link to this section Callbacks

Lexes a string into a list of tokens

Matches groups in a list of tokens.

Postprocesses a list of tokens before matching the contained groups.

Parses the given string into a parsec result that inludes a list of tokens.

Parses the smallest number of tokens that make sense. It’s a parsec.