ExC v0.2.0 Lexer View Source
Breaks the source code string (SCS) into an output list of tokens (OTL).
Link to this section Summary
Functions
Returns an output list of tokens (OTL) by breaking the source code string (SCS).
Link to this section Functions
Returns an output list of tokens (OTL) by breaking the source code string (SCS).
Specs
arg
is a tuple that contains the following elements:
- source_code_string: source code string.
- general_token_list: target language's valid token list. Refer to
Reader.read_code_and_tokens/3
for more information.