Provider implementation for Amazon Bedrock.
Handles chat completion requests through Amazon Bedrock Converse API. Any
Bedrock compatible model can be used. To specify any model-specific options for
the request, you can pass them in the request_params option and they will
be merged into the base request that is prepared.
Timeout configuration
The HTTP receive timeout (how long to wait for data from Bedrock before giving up) can be tuned via application config. The lookup order is:
config :llm_composer, :bedrock, receive_timeout: <ms>— Bedrock-specific overrideconfig :llm_composer, :timeout, <ms>— global llm_composer timeout- Default:
30_000ms (30 s)
Example:
config :llm_composer, :bedrock, receive_timeout: 60_000The timeout applies to all Mint-based requests (streaming and non-streaming). Finch regular (non-streaming) requests use Finch's own timeout configuration.