ExZarr.Broadway (ExZarr v1.1.0)

View Source

Broadway integration helpers for fault-tolerant Zarr processing pipelines.

Broadway is an optional dependency:

{:broadway, "~> 1.0"}

See livebooks/broadway_pipeline.livemd for a complete example.

Summary

Functions

chunk_pipeline_options(module, array, opts \\ [])

Returns Broadway child spec options for a chunk-processing pipeline.

start_chunk_pipeline(module, array, opts \\ [])

Starts a Broadway pipeline for chunk processing.

Functions

chunk_pipeline_options(module, array, opts \\ [])

@spec chunk_pipeline_options(module(), ExZarr.Array.t(), keyword()) :: keyword()

Returns Broadway child spec options for a chunk-processing pipeline.

start_chunk_pipeline(module, array, opts \\ [])

@spec start_chunk_pipeline(module(), ExZarr.Array.t(), keyword()) ::
  {:ok, pid()} | {:error, term()}

Starts a Broadway pipeline for chunk processing.