LLMUtils.Metrics (llm_utils v0.1.3)

Copy Markdown View Source

In-memory ETS-based metrics collector for LLM calls.

Usage

LLMUtils.Metrics.record(%{provider: "openai", tokens_in: 100, ...})
LLMUtils.Metrics.get_stats("openai")

Override by passing a module implementing record/1 and get_stats/1 in Client options.

Summary

Functions

get_stats(provider_id)

Get aggregated stats for a provider.

record(metrics)

Record a call metric.

reset()

Reset all metrics.

Functions

get_stats(provider_id)

@spec get_stats(String.t()) :: map()

Get aggregated stats for a provider.

record(metrics)

@spec record(map()) :: :ok

Record a call metric.

reset()

@spec reset() :: :ok

Reset all metrics.