Elasticlunr.Tokenizer (Elasticlunr v0.6.6) View Source

Link to this section Summary

Link to this section Functions

Link to this function

tokenize( str, separator \\ %{ __struct__: Regex, opts: "", re_pattern: {:re_pattern, 0, 0, 0, "ERCPi\0\0\0\0\0\0\0\x01\0\0\0\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\0\0\0\0\0\0\0\0\0\0@\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\x83\0%n\0>\0\0\x01 \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0kx\0%\0"}, re_version: {"8.44 2020-02-12", :little}, source: "[\\s\\-]+" } )

View Source

Specs

tokenize(binary() | number(), Regex.t()) :: [Elasticlunr.Token.t()]