Handle streaming of output generated by models.
The model detail returned by ExAws.Bedrock.get_foundation_model/1 must have:
responseStreamingSupported = trueThis requires hackney otherwise we will fail at runtime. It also assumes Jason is available
but we can improve this to lookup the ExAws JSON coded.
Summary
Functions
See ExAws.Request.Url.build/2.
Builds the hackney options for the streaming request.
Stream of chunks from the response stream.
Functions
See ExAws.Request.Url.build/2.
Builds the hackney options for the streaming request.
Merges caller-provided options from the ExAws config :http_opts (e.g.
recv_timeout, connect_timeout, pool) on top of the async-streaming
defaults. Without this, the stream would always use hackney's built-in
recv_timeout (5s) and drop slow responses regardless of the timeout the
caller configured.
The streaming defaults win on conflicting keys, so the async-streaming mode
(async: :once) and the forced HTTP/1.1 protocol can't be accidentally
disabled by caller options.
Stream of chunks from the response stream.
Raises on any error.