View Source Grammar.Tokenizer.TokenExtractorHelper (Grammar v0.3.0)
This module provides helper functions to work with TokenExtractor implementations using Regex.
Summary
Functions
Normalizes a regex to ensure it starts with ^
, while keeping the original options.
Tries to read a token from the input string using a regex pattern.
Functions
Normalizes a regex to ensure it starts with ^
, while keeping the original options.
Tries to read a token from the input string using a regex pattern.