Provider for the Groq API, using the Omni.Dialects.OpenAICompletions
dialect.
Reads the API key from the GROQ_API_KEY environment variable — no further
configuration is needed if the variable is set.
Configuration
Override the default API key or base URL via application config:
config :omni, Omni.Providers.Groq,
api_key: {:system, "MY_GROQ_KEY"}Any key from the provider's config/0 can be overridden: :api_key,
:base_url. See Omni.Provider for details.
Reasoning
The :thinking option is supported. Accepted effort levels vary by model
family — this provider normalises values so the standard option works
across all Groq-hosted reasoning models. In practice, :xhigh and :max
may be clamped to the model's maximum supported level.