ExC v0.2.0 Lexer View Source

Breaks the source code string (SCS) into an output list of tokens (OTL).

Link to this section Summary

Functions

Returns an output list of tokens (OTL) by breaking the source code string (SCS).

Link to this section Functions

Returns an output list of tokens (OTL) by breaking the source code string (SCS).

Specs

arg is a tuple that contains the following elements:

  • source_code_string: source code string.
  • general_token_list: target language's valid token list. Refer to Reader.read_code_and_tokens/3 for more information.