LLMProxy.ConcurrencyLimiter.Lease (llm_proxy v0.3.1)

Copy Markdown View Source

Concurrency lease returned by LLMProxy.ConcurrencyLimiter.

Obtain and release leases through the limiter rather than constructing them directly.

Summary

Types

t()

Types

t()

@type t() :: %LLMProxy.ConcurrencyLimiter.Lease{
  key_id: String.t(),
  limit: non_neg_integer(),
  ref: reference()
}