View Source AI.Tokenizer behaviour (fnord v0.4.32)

Summary

Callbacks

decode(list)

@callback decode(list()) :: String.t()

encode(t)

@callback encode(String.t()) :: list()