View Source ExEtlFramework.Pipeline (ex_etl_framework v0.2.0)

Provides a DSL for defining ETL (Extract, Transform, Load) pipelines.

This module allows you to define a series of steps that make up your ETL process. It handles the execution of these steps, including error handling and performance measurement.

Example

defmodule MyPipeline do
  use ExEtlFramework.Pipeline

  step :extract do
    {:ok, %{data: [1, 2, 3]}}
  end

  step :transform do
    {:ok, %{data: [2, 4, 6]}}
  end

  step :load do
    {:ok, %{result: "Data loaded successfully"}}
  end
end

Summary

Functions

Defines a step in the ETL pipeline.

Functions

Link to this macro

step(name, list)

View Source (macro)

Defines a step in the ETL pipeline.

This macro is used to define individual steps in your pipeline. Each step should return either {:ok, result} or {:error, reason}.

Parameters

  • name: Atom that identifies the step.
  • do: The block of code to be executed for this step.

Example

step :extract do
  {:ok, %{data: [1, 2, 3]}}
end