Voile.Migration.BiblioImporter (Voile v0.1.23)

Copy Markdown View Source

Imports bibliography/collection data from CSV files with optimized streaming and batch processing.

Expected CSV structure:

  • scripts/csvdata/biblio/biblio*.csv
  • scripts/csvdata/mst/mst_author*.csv (for author mapping)
  • scripts/csvdata/mst/mst_publisher*.csv (for publisher mapping)

Summary

Types

cache()

@type cache() :: %{
  author_mappings: map(),
  publisher_mappings: map(),
  creators: map(),
  existing_collections: MapSet.t(),
  unit_map: map(),
  resource_class_map: map()
}

Functions

ensure_virtual_folder(folder_path, unit_id, parent_id \\ nil)

ensure_virtual_folder_hierarchy(folder_path, unit_id, root_parent_id \\ nil)

import_all(batch_size \\ 1000, skip_images \\ false)

import_all_legacy(batch_size \\ 500, skip_images \\ false)