mix voile.update (Voile v0.1.48)

Copy Markdown View Source

Delta update task for importing new/changed data from SLiMS.

Designed for incremental updates: place only the new CSV files (exported since the last import) into the standard csv_data folders, then run:

mix voile.update

This runs three stages in order:

  1. Master data (authors, publishers) — safe to re-run, dedup by name
  2. Bibliography (collections) — safe to re-run, dedup by {unit_id, old_biblio_id}
  3. Items — continues item_code numbering from current DB state (no collisions)

Options

mix voile.update                       # Default: masters + biblio + items, skip images
mix voile.update --with-images         # Download cover images during biblio import
mix voile.update --batch-size 2000     # Custom batch size (default 500)
mix voile.update --skip-masters        # Skip author/publisher import
mix voile.update --skip-biblio         # Skip bibliography import

CSV file placement

Place CSV files in these directories (delete old files first):

scripts/csv_data/mst/        # mst_author*.csv, mst_publisher*.csv
scripts/csv_data/biblio/      # biblio_*.csv
scripts/csv_data/items/       # item_*.csv

In production (container):

/app/scripts/csv_data/