LLMProxy.Accounting.UsageTracking (llm_proxy v0.1.0)

Copy Markdown View Source

Usage accounting workflow for key counters, usage rows, optional traces, and user-message logging.

Summary

Functions

log_user_message(api_key, model, route, extractor)
maybe_record_trace(api_key, model, request_body, response_body, usage, opts)
track_usage(api_key, model, usage, opts \\ %{})

Functions

log_user_message(api_key, model, route, extractor)

maybe_record_trace(api_key, model, request_body, response_body, usage, opts)

@spec maybe_record_trace(map(), String.t(), map(), map(), LLMProxy.Usage.t(), map()) ::
  term()

track_usage(api_key, model, usage, opts \\ %{})

@spec track_usage(map(), String.t(), LLMProxy.Usage.t(), map()) :: :ok | term()