GenAI.Model.Encoder.DefaultProvider (GenAI Core v0.3.2)

Copy Markdown

Summary

Functions

apply_hyper_params_and_adjust(module, body, params, model, settings)
completion_choice(module, id, json, model, settings, session, context, options)
completion_choices(module, id, json, model, settings, session, context, options)
completion_response(module, json, model, settings, session, context, options)
default_hyper_params(module, model, settings, session, context, options)

Obtain list of hyper params supported by given model including mapping and conditional rules/alterations

encode_message(module, message, model, session, context, options)

Format message for provider/model type.

encode_tool(module, tool, model, session, context, options)

Format tool for provider/model type.

headers(module, model, settings, session, context, options)

Prepare request headers

hyper_params(module, model, settings, session, context, options)

Obtain list of hyper params supported by given model including mapping and conditional rules/alterations

normalize_messages(module, messages, model, session, context, options)
request_body(module, model, messages, tools, settings, session, context, options)

Prepare request body to be passed to inference call.

with_dynamic_setting(module, body, setting, model, settings, default \\ nil)

Set setting with dynamic model based logic.

with_dynamic_setting_as(module, body, as_setting, setting, model, settings, default \\ nil)

Set setting as_setting with dynamic model based logic.

Functions

apply_hyper_params_and_adjust(module, body, params, model, settings)

completion_choice(module, id, json, model, settings, session, context, options)

completion_choices(module, id, json, model, settings, session, context, options)

completion_response(module, json, model, settings, session, context, options)

default_hyper_params(module, model, settings, session, context, options)

Obtain list of hyper params supported by given model including mapping and conditional rules/alterations

encode_message(module, message, model, session, context, options)

Format message for provider/model type.

encode_tool(module, tool, model, session, context, options)

Format tool for provider/model type.

headers(module, model, settings, session, context, options)

Prepare request headers

hyper_params(module, model, settings, session, context, options)

Obtain list of hyper params supported by given model including mapping and conditional rules/alterations

normalize_messages(module, messages, model, session, context, options)

request_body(module, model, messages, tools, settings, session, context, options)

Prepare request body to be passed to inference call.

with_dynamic_setting(module, body, setting, model, settings, default \\ nil)

Set setting with dynamic model based logic.

with_dynamic_setting_as(module, body, as_setting, setting, model, settings, default \\ nil)

Set setting as_setting with dynamic model based logic.