Module tok_wordpiece

Function Index

encode_words/4
pre_tokenize/1

encode_words(Words, Vocab, UnkId, MaxChars) -> any()

pre_tokenize(Bin) -> any()

Generated by EDoc