BinClass.Tokenizer (BinClass v0.2.1)

Copy Markdown View Source

Summary

Functions

to_json(tokenizer)
train(data, opts \\ [])
vocab_size()

Functions

to_json(tokenizer)

train(data, opts \\ [])

vocab_size()