hnc_csv (hnc_csv v0.3.0)
View SourceCSV Decoder/Encoder
Summary
Functions
Decodes the raw CSV document in RawData
or provided by Provider
, using the given Options
, into a CSV data structure.
Adds another chunk of unprocessed RawData
to the given decoder State
.
Successively calls the given function Fun
with each CSV line decoded from the raw binary data in RawData
or provided by Provider
as argument.
Combines the functionality of decode_filter
and decode_map
.
Flushes a possibly unfinished line together with any yet unprocessed data from the state.
Successively calls the given function Fun
with each CSV line decoded from the raw binary data in RawData
or provided by Provider
as first and an accumulator as second arguments.
Successively calls the given function Fun
with each CSV line decoded from the raw binary data in RawData
or provided by Provider
as argument.
Equivalent to decode_init(<<>>, default_decode_options()).
Equivalent to decode_init(RawData, default_decode_options()) or decode_init(<<>>, Options), respectively.
Creates a CSV decoder state, prepopulated with the given RawData
and using the given Options
.
Equivalent to decode_map(ProviderOrRawData, default_decode_options(), Fun).
Successively calls the given function Fun
with each CSV line decoded from the raw binary data in RawData
or provided by Provider
as argument.
Decodes and returns the next CSV line in the given decoder state, together with an updated state which can be used for further incremental decoding.
Returns the default decode options.
Returns the default encode options.
Equivalent to encode(Lines, default_encode_options()).
Encodes the given CSV data structure into a CSV binary, using the given Options
.
Equivalent to get_binary_provider(Binary, 1024).
Creates a data provider from the given Binary
to supply data in chunks of the given ChunkSize
.
Equivalent to get_file_provider(IoDevice, 1024).
Creates a data provider from an open file given in IoDevice
to supply data in chunks of the given ChunkSize
.
Types
Functions
-spec decode(ProviderOrRawData) -> Lines when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Lines :: [Line], Line :: csv_line().
Equivalent to decode(ProviderOrRawData, default_decode_options()).
-spec decode(ProviderOrRawData, Options) -> Lines when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Options :: decode_options(), Lines :: [Line], Line :: csv_line().
Decodes the raw CSV document in RawData
or provided by Provider
, using the given Options
, into a CSV data structure.
The return value is a list of CSV lines, which in turn are lists of CSV fields, which in turn are binaries representing the CSV field values.
-spec decode_add_data(State0, RawData) -> State1 when State0 :: state(), RawData :: data(), State1 :: state().
Adds another chunk of unprocessed RawData
to the given decoder State
.
Returns an updated state with the given data added.
-spec decode_filter(ProviderOrRawData, Fun) -> Lines when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Fun :: fun((Line) -> boolean()), Line :: csv_line(), Lines :: [csv_line()].
Equivalent to decode_filter(ProviderOrRawData, default_decode_options(), Fun).
-spec decode_filter(ProviderOrRawData, Options, Fun) -> Lines when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Options :: decode_options(), Fun :: fun((Line) -> boolean()), Line :: csv_line(), Lines :: [csv_line()].
Successively calls the given function Fun
with each CSV line decoded from the raw binary data in RawData
or provided by Provider
as argument.
Returns a list of CSV lines for which Fun
returned true
.
-spec decode_filtermap(ProviderOrRawData, Fun) -> Result when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Fun :: fun((Line) -> boolean() | {true, Mapped}), Line :: csv_line(), Mapped :: term(), Result :: [Line | Mapped].
Equivalent to decode_filtermap(ProviderOrRawData, default_decode_options(), Fun).
-spec decode_filtermap(ProviderOrRawData, Options, Fun) -> Result when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Options :: decode_options(), Fun :: fun((Line) -> boolean() | {true, Mapped}), Line :: csv_line(), Mapped :: term(), Result :: [Line | Mapped].
Combines the functionality of decode_filter
and decode_map
.
-spec decode_flush(State) -> {Result, Rest} when State :: state(), Result :: undefined | Line, Line :: csv_line(), Rest :: data().
Flushes a possibly unfinished line together with any yet unprocessed data from the state.
If there is no possibly unfinished line in the state, the atom undefined
is returned instead of a line.
-spec decode_fold(ProviderOrRawData, Fun, Acc0) -> Acc1 when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Fun :: fun((Line, AccIn) -> AccOut), Line :: csv_line(), Acc0 :: term(), Acc1 :: term(), AccIn :: term(), AccOut :: term().
Equivalent to decode_fold(ProviderOrRawData, default_decode_options(), Fun, Acc0).
-spec decode_fold(ProviderOrRawData, Options, Fun, Acc0) -> Acc1 when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Options :: decode_options(), Fun :: fun((Line, AccIn) -> AccOut), Line :: csv_line(), Acc0 :: term(), Acc1 :: term(), AccIn :: term(), AccOut :: term().
Successively calls the given function Fun
with each CSV line decoded from the raw binary data in RawData
or provided by Provider
as first and an accumulator as second arguments.
Returns the final accumulator.
-spec decode_foreach(ProviderOrRawData, Fun) -> ok when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Fun :: fun((Line) -> _), Line :: csv_line().
Equivalent to decode_foreach(ProviderOrRawData, default_decode_options(), Fun).
-spec decode_foreach(ProviderOrRawData, Options, Fun) -> ok when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Options :: decode_options(), Fun :: fun((Line) -> _), Line :: csv_line().
Successively calls the given function Fun
with each CSV line decoded from the raw binary data in RawData
or provided by Provider
as argument.
-spec decode_init() -> State when State :: state().
Equivalent to decode_init(<<>>, default_decode_options()).
-spec decode_init(RawDataOrOptions) -> State when RawDataOrOptions :: RawData | Options, RawData :: data(), Options :: decode_options(), State :: state().
Equivalent to decode_init(RawData, default_decode_options()) or decode_init(<<>>, Options), respectively.
-spec decode_init(RawData, Options) -> State when RawData :: data(), Options :: decode_options(), State :: state().
Creates a CSV decoder state, prepopulated with the given RawData
and using the given Options
.
The return value can be used in the functions decode_add_data/2
, decode_next_line/1
and decode_flush/1
to incrementally decode a CSV document.
See also: decode_add_data/2, decode_flush/1, decode_next_line/1.
-spec decode_map(ProviderOrRawData, Fun) -> Result when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Fun :: fun((Line) -> Mapped), Line :: csv_line(), Mapped :: term(), Result :: [Mapped].
Equivalent to decode_map(ProviderOrRawData, default_decode_options(), Fun).
-spec decode_map(ProviderOrRawData, Options, Fun) -> Result when ProviderOrRawData :: Provider | RawData, Provider :: provider(), RawData :: data(), Options :: decode_options(), Fun :: fun((Line) -> Mapped), Line :: csv_line(), Mapped :: term(), Result :: [Mapped].
Successively calls the given function Fun
with each CSV line decoded from the raw binary data in RawData
or provided by Provider
as argument.
Returns a list of the values returned by Fun
.
-spec decode_next_line(State0) -> {Result, State1} when State0 :: state(), Result :: end_of_data | Line, Line :: csv_line(), State1 :: state().
Decodes and returns the next CSV line in the given decoder state, together with an updated state which can be used for further incremental decoding.
If the decoder state is exhausted, the atom end_of_data
is returned instead of a line. In this case, the function decode_add_data/2
can be used to add more data to the state, or decode_flush/1
can be used to flush a possibly unfinished line together with any yet unprocessed data from the state.
See also: decode_add_data/2, decode_flush/1.
-spec default_decode_options() -> decode_options().
Returns the default decode options.
separator
:$,
enclosure
:$"
quote
:enclosure
-spec default_encode_options() -> encode_options().
Returns the default encode options.
separator
:$,
enclosure
:$"
quote
:enclosure
enclose
:optional
end_of_line
:<<"\r\n">>
Equivalent to encode(Lines, default_encode_options()).
-spec encode(Lines, Options) -> RawData when Lines :: [Line], Line :: csv_line(), Options :: encode_options(), RawData :: data().
Encodes the given CSV data structure into a CSV binary, using the given Options
.
Equivalent to get_binary_provider(Binary, 1024).
-spec get_binary_provider(Binary, ChunkSize) -> Provider when Binary :: binary(), ChunkSize :: pos_integer(), Provider :: provider().
Creates a data provider from the given Binary
to supply data in chunks of the given ChunkSize
.
This provider can be used in decode_fold/3,4
, decode_foreach/2,3
, decode_filter/2,3
, decode_map/2,3
and decode_filtermap/2,3
.
-spec get_file_provider(IoDevice) -> Provider when IoDevice :: file:io_device() | io:device(), Provider :: provider().
Equivalent to get_file_provider(IoDevice, 1024).
-spec get_file_provider(IoDevice, ChunkSize) -> Provider when IoDevice :: file:io_device() | io:device(), ChunkSize :: pos_integer(), Provider :: provider().
Creates a data provider from an open file given in IoDevice
to supply data in chunks of the given ChunkSize
.
The file must have been opened with modes read
and binary
.
When the provider is exhausted, the position of the IoDevice
is at eof
.
The IoDevice
is not closed implicitly by the provider, instead the code using this provider is responsible for closing it.
This provider can be used in decode_fold/3,4
, decode_foreach/2,3
, decode_filter/2,3
, decode_map/2,3
and decode_filtermap/2,3
.