Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Restore permissions & roles (user/group permissions), if possible

Notes on AIP ingest speed

Some very basic ingestion speed tests were performed on a set of 26 AIPs (which represented a Community containing a Collection containing 24 Items). These tests found that, by default, the parsing/ingest settings are currently not optimized for speed.

Here are the basic (non-scientific) results

  • Default Settings (validates all METS files using external Schemas): took about 1 minute, 12 seconds to ingest all 26 AIPs
  • Locally cached all schemas (with validation turned on): took about 12 seconds to ingest all 26 AIPs
    • You can locally cache all schemas by using the mets.xsd.* settings in dspace.cfg
  • No validation (-o validate=false flag): took about 11 seconds to ingest all 26 AIPs

Discussion / Use Cases

Please add your own potential use cases or discussion topics

...