Stateless utility module for accurately estimating token usage of prompt templates. Uses Tiktoken under the hood to ensure operators are warned before hitting context limits.
Summary
Functions
Estimates token usage for a given prompt map or string.
Stateless utility module for accurately estimating token usage of prompt templates. Uses Tiktoken under the hood to ensure operators are warned before hitting context limits.
Estimates token usage for a given prompt map or string.