API Reference Unicode String v#2.4.0

Copy Markdown View Source

Modules

This module provides functions that implement some of the Unicode standards

Implements the Unicode break algorithms for graphemes, words, sentences and line-breaks.

CLDR's locale tailoring of the segmentation rules.

Implements the Unicode Case Folding algorithm.

The Unicode Case Mapping algorithm defines the process and data to transform text into upper case, lower case or title case.

Implements the special upper casing rules for for the Greek language.

The break-iteration algorithm described in PRI #555 (L2/26-135), section 9.3.2.

Compile-time reader for the break-iterator state machine data proposed in PRI #555 (L2/26-135).

Table-driven engine implementing UAX #29 grapheme cluster segmentation.

Table-driven engine implementing UAX #14 line breaking, with CLDR's CJK locale tailoring.

Table-driven engine implementing UAX #29 sentence breaking, with CLDR's locale tailoring and abbreviation suppressions.

Table-driven engine implementing UAX #29 word break.

Implements basic dictionary functions for dictionary-based work break.

Implements ICU's lookahead-based dictionary word break algorithm for scripts that don't use spaces between words.

A guard-safe test for the Extended_Pictographic property.

Optional ICU4C backend for segmentation.

Implements the compilation of the Unicode segment rules.

Mix Tasks

Downloads the ICU (Unicode) dictionaries supporting word breaks for Chinese, Japanese, Thai, Burmese and Laotion languages.