View Source AI.Tokenizer behaviour (fnord v0.4.15)

Summary

Callbacks

@callback decode(list()) :: String.t()
@callback encode(String.t()) :: list()