mix text.download_lid176 (Text v0.6.1)

Copy Markdown View Source

Downloads the fastText lid.176.bin model file used by Text.Language.Classifier.Fasttext for language identification.

The model is fetched from dl.fbaipublicfiles.com (the official fastText distribution endpoint) and saved to priv/lid_176/lid.176.bin inside this project.

The binary is approximately 126 MB and is not committed to the repo. Run this task once after cloning, or whenever you need to refresh the model.

Usage

mix text.download_lid176

Options

  • --force — re-downloads even if lid.176.bin is already present.

  • --quantized — downloads lid.176.ftz (the 917 KB quantized variant) instead of the full model. Currently informational only: Text.Language.Classifier.Fasttext does not yet support the quantized format.