GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1AutoraterConfig (google_api_ai_platform v0.27.0)
View SourceThe configs for autorater. This is applicable to both EvaluateInstances and EvaluateDataset.
Attributes
-
autoraterModel
(type:String.t
, default:nil
) - Optional. The fully qualified name of the publisher model or tuned autorater endpoint to use. Publisher model format:projects/{project}/locations/{location}/publishers/*/models/*
Tuned model endpoint format:projects/{project}/locations/{location}/endpoints/{endpoint}
-
flipEnabled
(type:boolean()
, default:nil
) - Optional. Whether to flip the candidate and baseline responses. This is only applicable to the pairwise metric. If enabled, also provide PairwiseMetricSpec.candidate_response_field_name and PairwiseMetricSpec.baseline_response_field_name. When rendering PairwiseMetricSpec.metric_prompt_template, the candidate and baseline fields will be flipped for half of the samples to reduce bias. -
samplingCount
(type:integer()
, default:nil
) - Optional. Number of samples for each instance in the dataset. If not specified, the default is 4. Minimum value is 1, maximum value is 32.
Summary
Functions
Unwrap a decoded JSON object into its complex fields.