View Source AWS.BedrockRuntime (aws-elixir v1.0.1)
Describes the API operations for running inference using Amazon Bedrock models.
Link to this section Summary
Functions
Invokes the specified Amazon Bedrock model to run inference using the prompt and inference parameters provided in the request body.
Invoke the specified Amazon Bedrock model to run inference using the prompt and inference parameters provided in the request body.
Link to this section Functions
Invokes the specified Amazon Bedrock model to run inference using the prompt and inference parameters provided in the request body.
You use model inference to generate text, images, and embeddings.
For example code, see Invoke model code examples in the Amazon Bedrock User Guide.
This operation requires permission for the bedrock:InvokeModel
action.
invoke_model_with_response_stream(client, model_id, input, options \\ [])
View SourceInvoke the specified Amazon Bedrock model to run inference using the prompt and inference parameters provided in the request body.
The response is returned in a stream.
To see if a model supports streaming, call
GetFoundationModel
and check the responseStreamingSupported
field in the response.
The CLI doesn't support InvokeModelWithResponseStream
.
For example code, see Invoke model with streaming code example in the Amazon Bedrock User Guide.
This operation requires permissions to perform the
bedrock:InvokeModelWithResponseStream
action.