ExArrow.Sink.Flight (ex_arrow v0.7.0)

Upload an Arrow stream or batch list to a Flight server.

Wraps ExArrow.Flight.Client.do_put/4. Emits a [:ex_arrow, :flight, :query] telemetry event with the destination descriptor in the metadata.

Example

{:ok, stream} = ExArrow.Stream.from_parquet("/data/events.parquet")
ExArrow.Sink.Flight.write(stream, client, descriptor: {:cmd, "events"})

Summary

Functions

write(source, client, opts \\ [])

Upload source to a Flight server via client.

Functions

write(source, client, opts \\ [])

@spec write(
  ExArrow.Stream.t()
  | {ExArrow.Schema.t(), [ExArrow.RecordBatch.t()]}
  | [ExArrow.RecordBatch.t()],
  ExArrow.Flight.Client.t(),
  keyword()
) :: :ok | {:error, term()}

Upload source to a Flight server via client.

Accepts the same source shapes as ExArrow.Sink.Parquet.write/2. opts are forwarded to ExArrow.Flight.Client.do_put/4 (e.g. :descriptor).

Returns :ok or {:error, reason}.