LLMProxy.Cache.Policy (llm_proxy v0.1.0)

Copy Markdown View Source

Resolves configured and per-request cache policy into a strict runtime policy struct.

Summary

Types

t()

Functions

resolve(request, context \\ %{})

Types

t()

@type t() :: %LLMProxy.Cache.Policy{enabled: boolean(), ttl_ms: pos_integer() | nil}

Functions

resolve(request, context \\ %{})

@spec resolve(LLMProxy.Protocol.Request.t(), map()) :: t()