Resolve "Ingest Storage Additions"

Work for the following issues

• #46 (closed)
• #47 (closed)
• #48 (closed)
• #53 (closed)
• #32 (closed)

These are all related in creating new data structures for distributing ingest, and as such are combined in a single merge request.