Local embedding provider using Bumblebee with sentence-transformers/all-MiniLM-L6-v2.

This is the default embedding provider for Recollect. It runs entirely locally — no API keys or external services required. Model weights are downloaded from HuggingFace Hub on first use and cached on disk.

Requirements

Add to your mix.exs dependencies:

{:bumblebee, "~> 0.6.0"}

Configuration

The local provider is used by default when no other provider is configured. You can explicitly select it:

config :recollect,
  embedding: [
    provider: Recollect.Embedding.Local
  ]

Options can be passed via :local_embedding:

config :recollect, :local_embedding,
  model: "sentence-transformers/all-MiniLM-L6-v2",
  compile: [batch_size: 32, sequence_length: 128]

Overriding with another provider

To use a different embedding provider (e.g. an API-based one), set the :provider key:

config :recollect,
  embedding: [
    provider: Recollect.Embedding.OpenRouter,
    credentials_fn: fn ->
      %{api_key: "...", model: "google/text-embedding-004", dimensions: 768}
    end
  ]