View Source ExEtlFramework.Pipeline (ex_etl_framework v0.2.0)
Provides a DSL for defining ETL (Extract, Transform, Load) pipelines.
This module allows you to define a series of steps that make up your ETL process. It handles the execution of these steps, including error handling and performance measurement.
Example
defmodule MyPipeline do
use ExEtlFramework.Pipeline
step :extract do
{:ok, %{data: [1, 2, 3]}}
end
step :transform do
{:ok, %{data: [2, 4, 6]}}
end
step :load do
{:ok, %{result: "Data loaded successfully"}}
end
end
Summary
Functions
Defines a step in the ETL pipeline.
Functions
Defines a step in the ETL pipeline.
This macro is used to define individual steps in your pipeline. Each step
should return either {:ok, result}
or {:error, reason}
.
Parameters
name
: Atom that identifies the step.do
: The block of code to be executed for this step.
Example
step :extract do
{:ok, %{data: [1, 2, 3]}}
end