DagsterPipes.Context (dagster_pipes v0.1.0)

The context of the Dagster Pipes process.

Summary

Functions

Returns a specification to start this module under a supervisor.

A key-value map for all extras provided by the user.

The job name for the currently executing run.

The partition key for the currently scoped partition.

Send a JSON serializable payload back to the orchestration process.

Create and initialize the pipes connection.

Functions

child_spec(init_arg)

Returns a specification to start this module under a supervisor.

See Supervisor.

close(context, exception \\ nil, stacktrace \\ [])

Closes the pipes connection.

extras(context)

A key-value map for all extras provided by the user.

job_name(context)

The job name for the currently executing run.

partition_key(context)

The partition key for the currently scoped partition.

report_asset_check(context, check_name, passed, severity \\ :ERROR, metadata \\ nil, asset_key \\ nil)

Report to the Dagster that an asset check has been performed.

report_asset_materialization(context, metadata \\ nil, data_version \\ nil, asset_key \\ nil)

Report to the Dagster that asset is materialized.

report_custom_message(context, payload)

Send a JSON serializable payload back to the orchestration process.

start_link(args \\ [])

Create and initialize the pipes connection.