Googly.DocumentAI.Model.GoogleCloudDocumentaiV1EvaluationMultiConfidenceMetrics (googly_document_ai v0.1.0)

Copy Markdown View Source

Metrics across multiple confidence levels.

Attributes

  • auprc (type: number()) - The calculated area under the precision recall curve (AUPRC), computed by integrating over all confidence thresholds.
  • auprc_exact (type: number()) - The AUPRC for metrics with fuzzy matching disabled, i.e., exact matching only.
  • confidence_level_metrics (type: list(Googly.DocumentAI.Model.GoogleCloudDocumentaiV1EvaluationConfidenceLevelMetrics.t())) - Metrics across confidence levels with fuzzy matching enabled.
  • confidence_level_metrics_exact (type: list(Googly.DocumentAI.Model.GoogleCloudDocumentaiV1EvaluationConfidenceLevelMetrics.t())) - Metrics across confidence levels with only exact matching.
  • estimated_calibration_error (type: number()) - The Estimated Calibration Error (ECE) of the confidence of the predicted entities.
  • estimated_calibration_error_exact (type: number()) - The ECE for the predicted entities with fuzzy matching disabled, i.e., exact matching only.
  • metrics_type (type: String.t()) - The metrics type for the label.

Summary

Types

t()

Types

t()

@type t() ::
  %Googly.DocumentAI.Model.GoogleCloudDocumentaiV1EvaluationMultiConfidenceMetrics{
    auprc: number() | nil,
    auprc_exact: number() | nil,
    confidence_level_metrics:
      [
        Googly.DocumentAI.Model.GoogleCloudDocumentaiV1EvaluationConfidenceLevelMetrics.t()
      ]
      | nil,
    confidence_level_metrics_exact:
      [
        Googly.DocumentAI.Model.GoogleCloudDocumentaiV1EvaluationConfidenceLevelMetrics.t()
      ]
      | nil,
    estimated_calibration_error: number() | nil,
    estimated_calibration_error_exact: number() | nil,
    metrics_type: String.t() | nil
  }