Penelope v0.5.0 mix nlp.pos_tagger.tagger_utils View Source

Common utility functions for part-of-speech tagger Mix tasks.

Link to this section Summary

Functions

Load a file containing tokenized text along with the tokens’ part-of-speech tags for either training or testing a tagger

Link to this section Functions

Link to this function ingest_file(file, options) View Source
ingest_file(file :: String.t(), options :: map()) ::
  {[[String.t()]], [[String.t()]]}

Load a file containing tokenized text along with the tokens’ part-of-speech tags for either training or testing a tagger.