GenAI.ModelDetail.Capacity (GenAI Core v0.3.2)

Copy Markdown

Provides standardized structure for tracking capacity details.

  • requests per minute
  • tokens per minute
  • tokens per day
  • inference_speed
  • vram

Summary

Types

t()

Types

t()

@type t() :: %GenAI.ModelDetail.Capacity{
  inference_speed: float() | nil,
  requests_per_minute: integer() | nil,
  tokens_per_day: integer() | nil,
  tokens_per_minute: integer() | nil,
  vram: integer() | nil,
  vsn: float()
}