GenAI.Provider.Cerebras (Noizu Labs, GenAI Wrapper v0.3.2)

Module for interacting with the Cerebras inference API.

Cerebras exposes an OpenAI-compatible API at https://api.cerebras.ai/v1, so it reuses the standard behaviour/encoder machinery unchanged (Bearer auth from config :genai, :cerebras, api_key:, default /v1/chat/completions endpoint).

Summary

Functions

chat(messages, tools, settings)

chat(model, messages, tools, hyper_parameters, provider_settings \\ [], context \\ nil, options \\ nil)

Callback implementation for GenAI.InferenceProviderBehaviour.chat/7.

config_key()

Return config_key inference provide application config stored under :genai entry

default_encoder()

effective_settings(model, session, context, options \\ nil)

Obtain map of effective settings: settings, model_settings, provider_settings, config_settings, etc.

endpoint(model, settings, session, context, options \\ nil)

Prepare endpoint and method to make inference call to

generate_media(request, options)

Callback implementation for GenAI.InferenceProviderBehaviour.generate_media/2.

headers(options)

headers(model, settings, session, context, options \\ nil)

Prepare request headers

models(settings \\ [])

Retrieves a list of models supported by the Cerebras API for the given user.

request_body(model, messages, tools, settings, session, context, options \\ nil)

Prepare request body to be passed to inference call.

run(session, context, options \\ nil)

Build and run inference thread

standardize_model(model)

Callback implementation for GenAI.InferenceProviderBehaviour.standardize_model/1.

stream(session, context, options \\ nil)

Build and run inference thread in streaming mode

supported_modalities()

Callback implementation for GenAI.InferenceProviderBehaviour.supported_modalities/0.