GenAI.ModelDetail.Capacity (GenAI Core v0.1.1)

Provides standardized structure for tracking capacity details.

  • requests per minute
  • tokens per minute
  • tokens per day
  • inference_speed
  • vram

Link to this section Summary

Link to this section Types

@type t() :: %GenAI.ModelDetail.Capacity{
  inference_speed: float() | nil,
  requests_per_minute: integer() | nil,
  tokens_per_day: integer() | nil,
  tokens_per_minute: integer() | nil,
  vram: integer() | nil,
  vsn: float()
}