Provider for the Groq API, using the Omni.Dialects.OpenAICompletions
dialect.
Not loaded by default — must be explicitly enabled. Either add it to your provider list in application config:
config :omni, :providers, [:anthropic, :openai, :google, :groq]Or load it at runtime:
Omni.Provider.load([:groq])Reads the API key from the GROQ_API_KEY environment variable — no further
configuration is needed if the variable is set.
Configuration
Override the default API key or base URL via application config:
config :omni, Omni.Providers.Groq,
api_key: {:system, "MY_GROQ_KEY"}Any key from the provider's config/0 can be overridden: :api_key,
:base_url. See Omni.Provider for details.
Reasoning
The :thinking option is supported. Accepted effort levels vary by model
family — this provider normalises values so the standard option works
across all Groq-hosted reasoning models. In practice, :xhigh and :max
may be clamped to the model's maximum supported level.