Behaviour for query rewriting in Arcana.Pipeline.

The rewriter transforms conversational input into clear search queries by removing filler phrases, greetings, and other noise while preserving the core question and important terms.

Built-in Implementations

• Arcana.Pipeline.Rewriter.LLM - Uses your LLM to rewrite queries (default)

Implementing a Custom Rewriter

defmodule MyApp.RegexRewriter do
  @behaviour Arcana.Pipeline.Rewriter

  @impl true
  def rewrite(question, _opts) do
    cleaned =
      question
      |> String.replace(~r/^(hey|hi|hello)[,!]?\s*/i, "")
      |> String.replace(~r/^(can you|could you|please)\s+/i, "")
      |> String.trim()

    {:ok, cleaned}
  end
end

Using a Custom Rewriter

Pipeline.new(question, repo: repo, llm: llm)
|> Pipeline.rewrite(rewriter: MyApp.RegexRewriter)
|> Pipeline.search()

Using an Inline Function

Pipeline.rewrite(ctx,
  rewriter: fn question, _opts ->
    {:ok, String.downcase(question)}
  end
)