Skip to content

Ingest Storage Additions

We will want the Ingest server to track staging areas in its database so that we can take in content from multiple nodes in Chronopolis.

To do this we'll need additions to both the DB and API. This issue is mainly for tracking, with more information for dev stored in the Chronopolis wiki.

Entity Additions

  • StorageRegion entity
    • Relation with Storage
    • Relation with Nodes
    • Relation with ReplicationConfiguration
  • Storage entity (name tbd, representation of a bag in storage)
    • Relation with Bag
    • Relation with StorageRegion

API Additions

  • StorageRegion API (should this be /storage or /region)
    • GET /api/storage
    • GET /api/storage/<id>
    • POST /api/storage
  • Storage API
    • Send storage information on init with Bag
    • Updateable through /api/bag/<id>/storage ??

DB Migrations

  • Initial StorageRegion/Storage tables
  • Default StorageRegion for existing bag and tokens
    • Create Migration
    • Test Configurations
      • Nodes + Bags exist
      • No Nodes or Bags exist
      • No Nodes exist but Bags exist -> should fail
  • Create a Storage entry for each Bag
  • Remove size and total_files columns from Bag
Edited by Ghost User