View Source AWS.BedrockRuntime (aws-elixir v1.0.1)

Describes the API operations for running inference using Amazon Bedrock models.

Link to this section Summary

Functions

Invokes the specified Amazon Bedrock model to run inference using the prompt and inference parameters provided in the request body.

Invoke the specified Amazon Bedrock model to run inference using the prompt and inference parameters provided in the request body.

Link to this section Functions

Link to this function

invoke_model(client, model_id, input, options \\ [])

View Source

Invokes the specified Amazon Bedrock model to run inference using the prompt and inference parameters provided in the request body.

You use model inference to generate text, images, and embeddings.

For example code, see Invoke model code examples in the Amazon Bedrock User Guide.

This operation requires permission for the bedrock:InvokeModel action.

Link to this function

invoke_model_with_response_stream(client, model_id, input, options \\ [])

View Source

Invoke the specified Amazon Bedrock model to run inference using the prompt and inference parameters provided in the request body.

The response is returned in a stream.

To see if a model supports streaming, call GetFoundationModel and check the responseStreamingSupported field in the response.

The CLI doesn't support InvokeModelWithResponseStream.

For example code, see Invoke model with streaming code example in the Amazon Bedrock User Guide.

This operation requires permissions to perform the bedrock:InvokeModelWithResponseStream action.