Exograph.Storage.FragmentStore (exograph v0.9.2)

Copy Markdown View Source

Durable fragment store backed by Ecto repositories.

Summary

Types

t()

Functions

all(store)
count(store)
get(store, fragment_id)
new(opts \\ [])
page(store, offset, limit, opts \\ [])
put(store, fragments)
rebuild_fragment_terms(opts)

Rebuilds the normalized fragment-to-term lookup table from persisted fragment term arrays.

term_frequencies(store, terms)

Types

t()

@type t() :: %Exograph.Storage.FragmentStore{
  defer_fragment_terms?: boolean(),
  duckdb_insert_buffer: pid() | nil,
  extractors: keyword() | [atom()],
  package: Exograph.Package.t() | nil,
  package_version: Exograph.PackageVersion.t() | nil,
  prefix: String.t(),
  repo: module(),
  static_atoms: atom()
}

Functions

all(store)

count(store)

get(store, fragment_id)

new(opts \\ [])

page(store, offset, limit, opts \\ [])

put(store, fragments)

rebuild_fragment_terms(opts)

@spec rebuild_fragment_terms(keyword()) :: :ok
@spec rebuild_fragment_terms(t()) :: :ok

Rebuilds the normalized fragment-to-term lookup table from persisted fragment term arrays.

Hex corpus indexing stores normalized term IDs on each fragment and defers the wide fragment_terms table for ingestion speed. This function materializes that lookup table before structural query workloads and final index optimization.

term_frequencies(store, terms)