GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1AutoraterConfig (google_api_ai_platform v0.27.0)

View Source

The configs for autorater. This is applicable to both EvaluateInstances and EvaluateDataset.

Attributes

  • autoraterModel (type: String.t, default: nil) - Optional. The fully qualified name of the publisher model or tuned autorater endpoint to use. Publisher model format: projects/{project}/locations/{location}/publishers/*/models/* Tuned model endpoint format: projects/{project}/locations/{location}/endpoints/{endpoint}
  • flipEnabled (type: boolean(), default: nil) - Optional. Whether to flip the candidate and baseline responses. This is only applicable to the pairwise metric. If enabled, also provide PairwiseMetricSpec.candidate_response_field_name and PairwiseMetricSpec.baseline_response_field_name. When rendering PairwiseMetricSpec.metric_prompt_template, the candidate and baseline fields will be flipped for half of the samples to reduce bias.
  • samplingCount (type: integer(), default: nil) - Optional. Number of samples for each instance in the dataset. If not specified, the default is 4. Minimum value is 1, maximum value is 32.

Summary

Functions

Unwrap a decoded JSON object into its complex fields.

Types

t()

@type t() :: %GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1AutoraterConfig{
  autoraterModel: String.t() | nil,
  flipEnabled: boolean() | nil,
  samplingCount: integer() | nil
}

Functions

decode(value, options)

@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.