API Reference

Modules

This module includes shortcut functions that bridge Gibran.Tokeniser and Gibran.Counter. This allows the caller to directly work with strings instead of tokenising the input first before applying any calculations

A set of functions that retrieve statistics on a list of tokens

This module contains functions that allow the caller to convert a string into a list of tokens using different strategies