FusionDSL v0.0.1-dev FusionDsl.Processor.Lexer View Source
Tokenizer and normalizer for FusionDsl
Link to this section Summary
Functions
Splits list of tokens to lists of lists by line with line number in beggining of each line
Tokenizes a FusionDsl Code
Link to this section Functions
Splits list of tokens to lists of lists by line with line number in beggining of each line
Tokenizes a FusionDsl Code
Lexical types:
- strings begining with quote (‘): immidiate string
- strings begining with percent sign (%): json object
- other strings: operators or identifires
- numbers: Immidiate number. float or integer.